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A.1-2 



INSTRUCTIONS: 



In this part of the survey, we are interested in your reactions to a series 
of hypothetical classroom situations and plans that various content area teachers 
might implement in these situations. Read each situation and plan and, on the 
basis of your experience as a classroom teacher , rate the plan on each of the 
scales listed below the item. 



Here are the different scales you will be using: 

practical 

Ineffective 

inefficient 

usefCT 



desirable 



impractical 

effective 

efficient 

useless 

undesirable 



Y;u are then asked to rate each plan on the basis ofM'ts feasibility in the 
classroom* For this part of the survey, you will also use a scale. This Is how 
the s:ale will appear. 



feasible 



not feasible 



Finally, you are asked to respond on a scale which indicates how skilled you 
are at this time for executing a plan like the one described. Here is how this 
win appear: 

skilled ^ : : : ; : : unskilled 

Here is how to use che scales: 

If you feel that the plan or question is very closely related to one end of 
:he scale, you should place your mark like this: 



practical 
practical 



OR 



impractical 

X impractical 



If you feel that the plan or question is quite closely related to one end of 



the scale (but not extremely), you should place your mark like this 

practical : X : : : : : impractical 

OR 

practical : : : : : X : impractical 



If you feel that the plan or question is only slightly related to one side or 
the other, place your mark this way: 



practical 
practical 



OR 



impractical 
impractical 
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A. 1-3 



INSTRUCTIONS: (continued) 

Finally, if you feel that the plan or Question is equally associated with 
either side of the scale or if you feel that the scale is completely irrelevant or 
unrelated to the plan, place your nark like this; 



practical 



impractical 



IMPORTANT: 



1. Do not place your mark between the boundaries; mark the middle of 
the spaces. 

2. Do not omit any of the scales; note that there are „w^„ scales to 
mark for each item, 

3. Do not put more than one mark on a scale. 

The following is a sample item to demonstrate the format of this survey; 
SAMPLE ITEM: 

SITUATION : A hrtae economics teacher is preparing questions to ask during a guided 
discussion aboui; menu planning, a topic on which the students have been doing in- 
dependent reading since the last class meeting. 

PLAN: The teacher plans to ask questions that represent various levels of com- 
prehension during the discussion. 



practical 
iueffective 
Inefficient 
useful 

desirable 



impractical 

effective 

efficient 

useless 

undesirable 



On the basis of your classroom experience, how feasible would you say the 
above plan is? 



feasible 



not feasible 



How skilled are you at this time for executing a pl^ like the one above? 



skilled 



unskilled 



You will find that a variety of content areas are represented in the hypo- 
thetical situations that follow. Rate each plan according to its appropriateness 
for the content area described even though this may differ from the one in which 
you have had experience. " 
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INSTRUCTIONS: (continued) 



Sometimes you may feel as though you've had the same item before on the 
inventory. This will not be the case so do not loolc bacic and forth through the 
items. Do not try to remember how you checked similar items earlier in the 
Inventory. Hake each item a separate and independent Judgment . Work at a fairly 
high speed through this inventory. Do not wrn or puzzle over individual items. 
It is your first impressions, the imnediate "fedlings" about the items, that we 
want. On the other hand, please do not be cerel^ss, because we want your true 
Impressions. ) 



PLACE YOUR RESPONSES IN THIS BOOKLET. DO NOT USE A SEPARATE ANSWER SHEET. 
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PART ONE 



1. SITUATION: A home economics teacher is preparing a unit on nutrition based on 
a chapter from a text labeled at the students' grade level. 

PLAN: The teacher plans to construct a short group diagnostic instrument based 
on the chapter which will indicate which students will be able to read the 
chapter on their own and which students will be unable to read the chapter at 
all or will need guidance in doing so. 



practical 
Ineffective 
Inefficient 
useful 

desirable 



impractical 

effective 

efficient 

Mseless 

undesiraole 



On the basis of your classroom experience, how feasible would you say the 
above plan is? 



feasible 



not feasible 



How skilled are you at this time for executing a plan like the one described 
above? 



skilled 



unskilled 



2* SITUATION: A math teacher is preparing a worksheet of word problems for a 
Class of students who have previously had difficulty with this type of work* 

PyN: Before assigning the worksheet, the teacher plans to work with the 
students on such comprehension skills as Identifying relevant details. ^ollo#- 
ing a sequence, and using efficient problem solving techniques. 



practical 
ineffective 
Inefficient 
useful 

desirable 



Impractical 

effective 

efficient 

useless 

undesirable 



On the basis of your classroom experience, how feasible would you say the 
above plan is? 



feasible 



not feasible 



How skilled o^e you at this time for executing a plin like the one described 
above? 



skilled 



unskilled 
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PArtT ONE (continued) 

3. SITUATION : An English teacher is preparing to teach a short story from the 
anthology suggested in the curnculttfn guide. 

PLAN: TKe teacher plans to assign those who are competent readers to fead 
the story on thei»* own and engage in several individualized assignments. The 
less competent readers will read the story in a guided reading lesson during 
which the teacher will provide considerable help In vocabulary, concept devel- 
opment, and con^rehenslon. 



practical 
Ineffective 
Inefficient 
useful 

desirable 



Impractical 

effective 

efficient 

useless 

undesirable 



On the basis of your classroom experience, how feasible would you say the 
above plan 1s7 



feasible 



not feasible 



How skilled are you at this time for executing a plan like the one described 
above? 



skilled 



unskilled 



SITUATION : A social studies teacher Is making plans for the content to be 
covered before ordering new reading materials. 

PLAN : The teacher Intends to include Informal assessment of the reading levels 
of students before selecting materials to order. 



practical 
Ineffective 
Inefficient 
useful 

desirable 



impractical 

effective 

efficient 

useless 

undesirable 



On the basis of your classroom experience, now feasible would you say the 
above plan 1s7 



feasible 



not feasible 



How skilled are you at this time for executing a plan like the one described 
above? 



skilled 



unskilled 
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PART ONE (continued) 

5, SITUATION An English teacher Is preparing a unit on the short story with 
emphasis on the structure of a good story. 

PLAN: The teacher pla. s to divide the class Into groups based on reading 
ability and to assign each a story of appropriate difficulty level. When the 
groups have completed their reading, the whole class will "discuss conwon ele- 



ments of structure in short stories. 



practical 

Ineffective 
Inefficient 
useful 
desirable 



Impractical 

effective 

efficient^ 

useless 

undesirable 



On the basis of your classroom experience, how feasible would you say the 
above plan Is? 



feasible 



nrot feasible 



How skilled are you at this time for executing a plan like the. one described 
above? 



skilled 



unskilled 



6. SI TUATION : A social studies teacher observes that students are having 
difficulty comprehending the textbook. 

PLAN : The teacher identifies several comprehension skills the students need 
in reading the text and uses informal assessment to determine which students 
need instruction in these skills. 



r 



practical 
ineffective 
inefficient 
useful 

desirable 



impractic^^l 

effe/^ive 

efficient 

useless 

undesirable 



On the basis of your classroom experience, how feasible %)uld you say the 
above plan is? 



feasible 



not feasible 



How skilled are you at this time for executing a plan like the one described 
above? 



skilled 



unskilled 
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PART ONE (continued) 

7. SITUATION : A math teacher Is planning a unit on comparative measurement 
which includes problems Involving the Interpretation of charts and graphs. 

PLAN : The teacher plans to spend some time Instructing students in the skills 
needed to Interpret various charts and graphs before assigning the math prob- 
lems in the unit. 



practical 
ineffective 
inefficient 
useful 
( Nlesirable 



impractical 

effective 

efficient 

useless 

undesirable 



On the basis of your classroom experience, how feasible would you say the 
above plan is? 



y 



feasible 



not feasible 



How skilled are you at this time for executing a plan like the one described 
above? 



•-.Hilled 



unskilled 



8. SITUATION ; An English teacher has Identified several students as lacking 
skill In figuring out fifords containing prefixes and suffixes, ^ 

PLAN : The teacher plans to take part of several class per/ods to instruct 
these students in this skill while the rest of the class it involved in other 
meaningful activities. They will then oractice utilizing ttlis skill independ- 
ently by using self-instructional materials prepared by the teacher. 

r 



practical 
Ineffective 
inefficient 
useful 

desirable 



impraijttical 
effective \ 
efficient 
useless 
undesirable 



On the basis of your classroom experience, how feasible would you say the 
above plan Is? 



feasible 



not feasible 



How skilled are you at this time for executing a plan like the one described 
above? 



skilled 



unskilled 
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A. 1-9 

PART ONE (continued) 

9. SITUATION : A health education teacher Is concerned that students are not 
getting the essential information from assigned chapters. 

PLAN: The teacher thinks that if students could make brief outlines, take 
notes* or summarize the chapters, their^jcomprehension might be Increased. 
The teacher devises a brief diagnostic exercise for determining whether or 
not students are able to perform these skills efficiently. 



practical 
Ineffective 
inefficient 
useful 

desirable 



Impracti cal 

effective 

efficient 

useless 

undesirable 



On the basis of your classroom experience, how feasible would you say the 
above plan Is? 



feasible 



not feasible 



How skilled are you at this time for executing d plan like the one described 
above? 



skilled 



unskilled 



10. SITUATION : A social studies teacher Is planning to teach a unit on the elec- 
tion process In the United States. 

PLAN: In order to accommodate the different reading levels In the classroom, 
the teacher has gathered a wide variety of materials concerned with the topic 
and hos made certain that material at several reading levels Is represented. 



practical 
Ineffective 
Inefficient 
useful 

desirable 



Impractical 

effective 

efficient 

useless 

undesirable 



On the basis of your classroom experience, how feasible would you say the 
above plan is? 



feasible 



not feasible 



How skilled are you at this time for executing a plan Kke the one described 
above? 



skilled 



unskilled 



\/mc 



11 



4 



PART. ONE (continued) 

11. SITUATION : A team of English and social studies teachers Is making plans for 
guiding students in "the writing of a research paper on one aspect of the 
Depression Years. • ^ 

PLAN ; The teachers plan to devise an inventory of various study skills (such 
as using the card catalog, using the Reader's Guide to Periodical Literature , 
compiling a bibliography, and writing footnotes) students will need to use in 
completing this assignment In order to assess which students have or have not 
mastered these skills. 



practical 
Ineffective 
Inefficient 
useful 

desirable 



Impractical 

effective 

efficient 

useless 

undesirable 



On the basis of your classroom experience, how feasible would you say the 
above plan Is? 



feasible 



not feasible 



How skilled are you at this time for executing a plan like the one described 
above? 



skilled 



unskilled 



12. SITUATION: A vccatijonal teacher Is setting up orientation sessions for stu- 

dents without previous experience in the wood-working shop. During a nine 
week pertod in this shop, each student will construct one item using written 
directions following teacher demonstrations of equipiTwnt. 

PLAN : The teacher plans to examine each set of written directions, select- 

ing those words which occur frequently in most of the plans for use in a 
group vocabulary lesson to be taught as part of the orientation. 



practical 
ineffective 
inefficient 
useful 

desirable 



1 



impractical 

effective 

efficient 

useless 

undesirable 



On the basis of your classroom experience, how feasible would you say the 
above plan is? 



feasible 



not feasible 



How skilled are you at this time for executing a plan like the one described 
above? 



skilled 



unskilled 
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INSTRUCTIONS: 



The following are statements about instructional procedures of content area 
teachers. The intent of this survey is to determine how you feel about these 
procedures in relation to your own teaching situation. 

Read each statement and rate it according to your experience in your class- 
room. Please note that the general term teachers which appears in each statement 
is meant to include all teachers in the content areas such as in English, language 
education, social studies, science, math, home economics, health education, vo- 
cational education, art education, music education, reading, and adult education. 

You are to rate each statement on the following scale which appears below 
each item; the scale appears for each item in your booklet, but do not mark the 
booklet . Use the separate answer sheet provided. 

(a) : (b) ; (c) : (d) : (e) 

Strongly Slightly Not Sure Slightly Strongly 
Disagree Disagree Agree Agree 

Here is how to use the scale: 

If you "strongly disagree" with the statement, fill in the space marked (a) 
on your answer sheet; If you "slightly disagree" with the statement, fill in the 
space marked (b) on your answer sheet; if you are "not sure" about the statement, 
fill in the space marked (c) on your answer sheet; if you "slightly agree" with 
the statement, fill in the space marked (d) on your answer sheet; and if you 
"strongly agree" with the statement, fill in the space marked (e) on your answer 
sheet. 

REMEMBER: DO NCT PLACE YOUR RESPONSES IN THIS BOOKLET. USE THE SEPARATE ANSWER 
SHEET PROVIDED. 
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A. 2-3 

PART TWO 

1. It Is Important that teachers be competent In assessing the general reading 
levels of students. 

(a) ; (b) : (c) ; (d) ; (e) 
Strongly Slightly Not :ure Slightly Strongly 
Disagree Disagree Agree Agree 

2. It is inappropriate for teachers to devote class instruction time to vocab- 
ulary development. 

(a) : (b) ; (c) : (d) ; (o) 
Strongly Slightly Not Sure Slightly Strongly 
Disagree Disagree Agree Agree 

3. All teachers should be able to provide alternative means by which students 
can obtain information they may be unable to read. 

_ (a) ; (b) ; (c) ; (d) ; (e) 
St^ngTy Slightly Not Sure Slightly Strongly 
Disagree Disagree Agree Agree 

4. It is inappropriate for teachers to assess students' specific comprehension 
skills such As making inferences, following sequence, detecting bias or 
recognizing^in ideas. 

- -. : (b) : (c) : (d) ; (e) 
Strongly Slightly Not Sure Slightly Strongly 
Disagree Disagree Agree Agree 

5. It is Important that teachers provide a variety of materials which cover 
similar content but which represent a wide range of readability. 

^^K • ' • ■■^d) ; (e) 

Strongly Slightly Not Sure Slightly Strongly 
Disagree Disagree Agree Agree 

6. It is important that teachers be able to identify those students who are 
having trouble figuring out unfamiliar words. 

Strongly Slightly Not Sure Slightly Strongly 
Disagree Disagree Agree Agree 

7. It is not Important for teachers to conduct guided or directed reading 
lessons for students* unable to read the text on their own. 

(a) : (b) : (c) ; (d) ; (e) 
Strongly Slightly Not sure Slightly Strongly 
Disagree Disagree Agree Agree 
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PART TWO (continued) 



8. It is not necessary for teachers to develop and use diagnostic Instruments 
for assessing mastery of skills needed In their subject area(s). 

(a) : (b) ; (c) : (d) : (e) 
Strongly Slightly Not Sure Slightly Strongly 
Disagree Disagree Agree Agree 

9. Teachers should Include questions at various comprehension levels In class 
discussions. Morksheets, study guides and tests. 

, (a). : „.(b). : (c} : , (d ) . : ^ (e) 

Strongly Slightly Not sure Slightly Strongly 
Disagree Disagree Agree Agree 

10. It is . not important for teacher' to be able to develop and use Instruments 
for diagnosing nuistery of reading skills. 

(a)_ : (b) : (c) : (d) : (e) 
Strongly Slightly Not Sure Slightly Strongly 
Disagree Disagree Agree Agree 

11. Teachers should not spend class Instruction time teaching students study 
skills. 

(a) ; (b) ; (c) ; (d) ; (e) 

Strongly Slightly Not Sure Slightly Strongly 

Disagree Disagree Agree Agree 

12. It is desirable that teachers determine for which students a reading 
selection is or is not appropriate. 

_(al^:_(b)_:^_(c}^:_(d)_.__(el_ 
Strongly Slightly Not Sure Slightly Strongly 
Disagree Disagree Agree Agree 

13. Teachers should teach those reading skills needed in their subject ar6a(s}. 

h) ; (b) ; (c) ; (d) ; (e) 

Strongly Slightly Not Sure Slightly Strcr.yiy 
Disagree Disagree Agree Agree 

14. Only reading teachers should provide materials written at various reading 
levels for groups of students with differing reading abilities. 

(a) ; (b)_ ; (c) : (d) : (e) 
Strongly Slightly Not Sure Slightly Strongly 
Disagree Disagree Agree Agree 
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PART TWO (continued) 

15. Teachers should know how to assess mastery of the comprehension skills 
needed In their subject arGa(s). 

(a) : (b) ; {c) : id) : (e) 
Strongly Slightly Not Sure Slightly Jtiongly 
Disagree Disagree Agree Agree 

16. Only reading teachers should be concerned with diagnosing vocabulary develop- 
ment of students beyono the elementary school level. 

(a) ; (b) : jc) : (dj : (ej 
Strongly Slightly Not Sure Slightly Strongly 
D1 sagree D1 sagree Agree Agree 

17. It Is necessary that teachers be able to Identify those reading skills 
specifically needed in their subject areas, 

(a) : (b) : (c) : (d) : (e) 
Strongly Slightly Not Sure Slightly Strongly 
Disagree Disagree Agree Agree 

18. Content teachers should not need to develop skill in assessing student 
strengths and weaknesses in various study skills. 

(aj : {b) : (c) : (d) : (e) 
Strongly Slightly Not Sure Slightly Strongly 
Disagree Disagree Agree Agree 

19. It U not desirable for teachers to conduct small group lessons in specific 
reading skills. 

(a) : (b) : (c) : (d) : (e) 
Strongly Slightly Rot Sure Slightly Strongly 
Disagree Disagree Agree Agree 

20. It is appropriate for teachers to identify those students who are experiencing 
reading difficulties because of language differences such as a dialect or 
second language. 

(a) : (b) : (c) : (d) : (e) 
Strongly Slightly Not sure Slightly Strongly 
Disagree Disagree Agree Agree 



i; 
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horms A and B Combined 
A.3 



- THE PURDUE TEACHER OPINIONAIRE ^ 

Prepared by Ralph R. Bentley and Averno M. Rempcl ^ 

This instrument is designed to provide you the opportunity to express your opinions about your 
^ work as a teacher and various school problems in your particular school situation. There are no right 
or wrong responses, so do not hesitate to mark the statements frankly. 

-FORM A USE WHEN RECORDING RESPONSES ON OPINIONAIRE 



DIRECTIONS FOR RECORDING RESPONSES ON OPINIONAIRE 
Fill in the ih^^nmation below. You will notice that there is no place for your name. Please 
do not record you^f^me. All responses will be strictly confidential and result^ill be reported 
by groups only. DO Nb^^MIT ANY ITEMS. 

School >v Date_ 

day year 

Age Sex highest Degree Cot 



Read each statement carefully. Then inH^cate whpifler you agree, probably agree, probably 
disagree , or disagree with each statement. Nl^k^our answers in the following manner: 

If you agree with the statement, circlej/k^^. ..^^ PA PD D 

If you are somewhat uncertain, butprobably agree wK(i the statement, ^^^^ 

circle TA" A @ PD D 

If you are somewhat uncertain, but probably disagree witnthe state- 
ment, circle "PD" A PA (pra D 



If you disagree wjjjr^e statement, circle "D* A PA PD 



-FO RM B USE WHtH RECORDI HG RESPONSES OW jSEPARATE RESPONSE CARD? 

.V 




DIRECTIONS FOR RECORDING RESPONSES ON RESPONSE CARD 

A separate answer card is furnished for your responses. Fill in the information requested 
on the answer card. You will notice that there is no place for your name. Please do not record 
your name. All response.s will be strictly confidential and results will be reported bv groups 
only. DO NOT OMIT ANY ITEMS. 

Read each statement carefully. Then indicate whether you agree, probably agree, probably 
disagree , or disagree with each statement. Mark your answers on the separate answer card 
in the following manner: ft d J5 

A PA PD D 

If you agree with the statement, blacken the space | 

If you are somewhat uncertain, but probably agree with the state 
ment. blacken the space A 

If you are somewhat uncertam, but probably disagree with the state 
ment, blacken the space 

If you disagree with the statement, blctken the space 



A 



n 


n 




PA 


PO 


0 




^ 








r\ 


1 


PO 


0 














PA 


1 


0 








n 






PA 


PO 


1 


\j 







All marks should be heavy and completely fill the answer space. If you change a response, 
erase the first mark completely. Use No 2 or special mark - sense pencil. Make no stray 
marks on the answer card. Please do not mark this booklet 



24. Teaching enables me to make my greatest contribution to society Ji PA PD D 

25. The curriculum of our school is in need of major revisions A PA PD D 

26. Hove to teach A PA PD D 

27. If I could plan my career again, I would choose teaching ^ A PA PD D 

28. Experienced faculty members accept new and younger members as colleagues. A PA PD D 

29. I would recommend teaching as an occupation to students of high scholastic abili^ PA PD D 

30. U I cou'd earn as much money in another occupation, I would stop teaching. A PA PD D 

31. The school schedule places my classes at a disadvantage.^ ^ Ji pA PD D 

32. Within the limits of financial resources, the school tries to follow a generous 

policy regarding fringe benefiU, professi<mal tra\ el, professional study, etc ....A PA PD D 

33. My principal makes my work easier and more pleasant A PA PD D 

34. Keeping up professionally is too much of a burden A PA PI3 D 

35. Our community makes its teachers feel as though they are a real part of the 

community .... „.A PA PD D 

36. Salary policies are administered with fairness and justice A PA PD D 

37. Teaching affords me the security I want m an occupation A PA PD D 

38. My school principal understands and recognizes good teaching procedures A PA PD D 

39. Teachers clearly understand the policies governing salary increases Ji PA PD D 

40. My classes are used as a "dumping ground** for problem students .A PA PD D 

41. The lines and methods of communication between teachers and the prmcipal m 

our school are well developed and mamtamed A PA PD D 

42. My teaching load in this school is unreasonable A PA PD D 

43. My principal shows a real interest m my department A PA PD D 

44. Our principal promotes a sense of belonging among the teichers in our school. A PA PD D 
45 My heavy teaching load unduly restricts my nonprofessional activities A PA PD D 
46. I find my conUcts with students, for the most part, highly satisfying and rewardmg. A PA PD D 
17. I feel that I am an important part of this school system . A PA PD D 

48 The competency of the teachers m our school compares favorably with that of 

teachers m other schools with which I am familiar A PA PD n 



Contimie with item 49 on next pajje 
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73. My principal ha5 a reasonable undemanding of the problems connected with my 
tcarhirf assignment . . pp 

74. Heel tb^t my work is judged fairly by my principal A PA PD D 

75. Salaries paid in this school system conipare favorably with salaries in other sys- 
tems with which I am familiar A PA PD D 

76. Most of the actions of students irriUte me „ _ PA PD D 

77. The cooperaUveness of teachers in our school helps make my woric more 
"i^y*"* - ^ - Ji PA PD D 

78. My studenU regard me with respect and seem to have confidence in my profes- 
^^^^y - - ^ ^ PA PD D 

79- Thepurposesandobjectiv^sof the school cannot be achieved by the present 

■■: - ^ -A PA PD D 

80. Tlie teachers in oar school have a desirable influence m the values and attitudes 
of their students ^ ^ ^ PA PD D 

81. 'niis community expects its teachers to meet unreasonable personal standa^ A PA PD D 

82. My StudenU appreciate the help I give them with their school work... _A PA PD D 

83. To me there is no more challenging work than teaching PA PD D 

84. Other teachers in our school are apfweciative of my work ^ „ _ Ji PA PD D 

85. As a teacher in this community, my nonprofessional activities outside of school 
are unduly restricted ^ ^ pj^ ^ 

86. As a teacher, I thmk I am as competent as most other teachers Ji PA PD D 

87. The teachers with whom I work have high professional ethics A PA PD D 

88. Our school curriculum does a good job of preparing stud^ts to become enlight- 
ened and competent citizens A PA PD D 

89. I really enjoy working with my students pA PD D 

90. The teachers in our school show a great deal of initiative and creativity in their 
teaching assignments A PA PD D 

91. Teachers m our community feel free to discuss controversial issues m their classes A PA PD D 

92. My pnncipai tries to make me feel comfortable when he v^its my classes A PA PD D 

93. Myprincipalmakeseffectiveuseof the mdividual teachers capacity and talent. A PA PD D 

94. The people in this conmiunity, generally, have a jincere and wholehearted mterest 
m the school system A PA PD D 

ConJtnue wtfh item 95 on nett page 
O ' (51 
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CONTENT AREA READING SKILLS INSTRU.1S:a 

These multiple choice questions are dwic]r>©d to test your knowledge of basic ma* 
terials and methods for teaching reading in various content areas. 

Answer each question by marking the letter of the best choice on the answer sheet 
provided. Please answer each itOT. Mark answer e if you really do not know the 
answer and prefer not to guess. Ue are more interested in what you know than in a 
lucky guess. 

!• Using various levels of questions in class discussions and on study guides, 
worksheets, and tests is generally thought to nelp students increase skill in 
which one of the following areas? 

a. comprehension skills 

b. study skills 

c. word recognition skills 

d. vocabulary skills 

G. I honestly don't know 

2. Cloze procedure may be usod to devise mttarial to provide students with 
practice in using which one of the following skills? 

a. map and gr^ph skills 

b. computational skills 

c. sight word skills 

d. context skills 

e. I honestly don't knov? 

3. Re2d the following statemwts. Three of then reflect the philosophy that 
language variations arnong students should be considered "differences", not 
"deficits". Which of the statements does not reflect this view? 

a. Many so-called "disadvantaged" students fail to learn because of their 
inability to produce standard English. 

b. The characteristics of a child's spoken language do not interfere with 
the development of concepts. 

c. If readers accurately trnnslate a printed massage into their own dialects, 
they are reading successfully. 

d. Teachers' nonaccept^nce of students' language and culture can lead to poor 
academic performance. 

e. I honestly don't know 
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4. A cHterl0f\-refercnceJ test will nost lik3ly be usod to obtain what kind of 
Information? 

a. a student* s performance coicpared to that of national norms 

b. a student's performance compared to that of his or her classnates 

c. the appropriateness of the textbook being used in a cont2nt area 

d. determining whether or not students have mastered specific objectives 

e. I honestly don't know 

5. A content area teacher has acfcilnlstered an Infonoal reading Inventory with a 
cloze test and has determined which students will probably benefit from a di- 
rected reading lesson on a text chapter; which of the following "alternative 
strategies" might be most appropriate for those students which the test re* 
suits Identified as unable to participate In the directed reading lesson or 
read the chapter Independently? 

a. an oral reading of the chapter In a small group 

b. assignment of a study guide to use as they read silently 

c* use of a taped version of the chapter or a rewritten, simplified version 

d. assignment of a series of questions of varying levels to be answered as 
they read the chapter Individually 

e. I honestly don't know 

6. The following subskris represent what general skills area In reading? 

1) following a sequence. 2) Identifying a main idea or theme, 3) recalling or 
recognizing details. 

a. dictionary skills 

b. structural analysis skills 

c. word recognition skills 

d. comprehension skills 

e. I honestly don't know 

7. Use of tne Fry Graph gives teachers an idea of readability according to which 
of the following crit<:ria? 

a. semantic density 

b. vocabulary difficulty 

c. nunber of symbolic representations per one hundred word passage 

d. average number of syllables and average length of sentences 



ERTC «• I honestly don't know 2 
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8. AU of the following are noccssary conponcnts ot a U:rn1m Activity Pzz\^t 
except : 

a. pretest 

b. teaciHJr strategies 

c. instructional objectives 

d. student activities 

e. I honestly don't know 

Jfrlf,'^^"'^ * percentile of 85 on the reading subtest of the Iowa Test 6f Bisic 
Skills; this means that he: 

a. outsc«red 85 of every 100 children his age with whom he is bPing cowpared 

b. answered 85X of the questions correctly 

c. - outscored 15« of the children in a local school district sample 

d. perfonned in the 4th stanine on this test 

e. I honestly don't know 

10. All of the following are necessary components of a textbook evaluation except ; 

a. development of a learning activity packet 

b. an assessment of readability 

c. consideration of organization of natjrial 

d. analysis of mechanics arfd study aids 
c. I honestly don't know 

11. If several students appear to be having difficulty figuring out how to pro- 
nounce such words as international , interstate , interdependent , populat ion, 
denomination, and autonatlon . they would likely benefit most from some small 
group Instruction in: 

a. phonic analysis 

b. concept development 

c. structural analysis 

d. context clues 

e. I honestly don't know 
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A. cloze procedure constructed from a content area textbook selection might be 
used diagnostioally to detGrwine: j 

' / 

a. the reliability of the publisher's grade level designation 

b. 'or which students tho selection is of appropriate readability 

c. the Semantic density of the selection 

d. whether the selection represents various comprehensioji levels 

e. I honestly don't know 

13. for conducting guided^or directed reading lessons the content area teacher 
would pri«arily need to consider the students' reading levels. 

a. frustration 

, b. independent 

c. recreational »^ 

d. instructional 

e. I honestly don't know 

14. T>.e following represent hypothetical questions which most\li-kel^ tap what 
level of jtiestioning? 1) what do you think happened *j us t before {4r. Swartz 
entered we storeroom? 2) What preparation do you think we might make before 
we begin to build this model according to the direciiions ir» your book? 
3) What reason can you give -for this jtep of the proof that the angles in a 
triangle equal 180'? 

a. evaluative 

b. literal 

c. appreciative 

d. inf-^rential 

e. I hcrt^stly don't know 

15. A study technique often recommended for guiding students in organizing and 
retaining the major ideas of reading assignments is known as: 

a. previaw, survay, overview 

b. SQ3R 

c. differentiating concepts 

d. the maze technique 
c. I honestly don't know 

9^ O ' 
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16. An infoiinal reading inv*?ntory or a cloze t^zt can giv^ tne toacher Information 
about which one of the- following studcint reading abilities? 

a. only the frustration It-v^l 

b. the independent, Instructional, and frustration levels 

c. only the Independent level 

^ d. the independent and recroatibaal levels 
e. I honestly don't know 

« 

17. In general, readability levels for content aroa textbooks can be considered 
to be I the grade level designations provided by the publishers. 

a. about the sam^ as 

b. slightly lower than 

c. somewhat higher than 

d. exactly the same as 

e. I honestly don't know 

18. The following hypothetical questions most likely represent what level of 
questioning? 1) What town does the main character live in? 2) Where did 
the boys find the treasure? 3) What two elements combine to form the formula 
for the chemical to be used In the experiment? 

a. Inferential 

b. appreciative 

c. literal 

d. evaluative 

e. I honestly don't know 

19. If an assessment procedure Indicates that a content area selection represents 
Independent reading for a group of students, which of the following activities 
Is probably the most desirable option for these students? 

a. assignment of the selection (with possibly an additional selection on a 
related topic) to be read on their own 

Ignment of the selection to be read during a guided or directed 
reading lesson 

c. assignment of a listening experience In which the students hear a taped 
version of the selection 

d. use of a film or fllmstrlp which deals with the topic In the selection 
O e- I honestly don't know 
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20. An individually-administered informal reading inventory might be more beneficial 
than a group Informal reading inventory If the toacher wishes to obtain what 
information? ^ 

a. an analysis of a students spocitic spoiling difficulties 

b. an oral sampling of a student's reaJing 

c. * a student's performance on unfamiliar material 

d. a sample of behaviors representing the frustration level 

e. I honestly don't know 

21. A group Informal reading Inventory gives the teacher Information about: 

a. both the range of reading ability and the general skill levels among 
students 

b. the various reading levels of students 

c. the skill strengths and weaknesses of students 

d. the students* ability to use context clues 

e. I honestly don't know 

22. An example of a student-dlrectod delivery system for instruction Is the: 

a. unit 

b. teaming activity packot 

c. cloze procedure 

d. InfonrtQl reading Inventory 

c. I honestly don't know 

23. Which of the following most likely represents the hierarchy of levels of 
comprehension from low to high? 

a. literal. Inferential, evaluative, appreciative 

b. evaluative, Inferential, literal, appreciative 
literal, evaluative, appreciative, inferential 

d. appreciative, evaluative, literal. Inferential 

e. I honestly don't know 
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CHAPTER III* 



PROCEDURES 



In this chapter, thk following aspects of methodology are con-^ 
sldered: (1) selection and development of the Instruments, (2) 
selection of population, (3) treatment, (4) evaluation procedures, 
and (5) limitations of the study. 

Selection and Development of Instruments 

Five Instruments were used In this Investigation. Four of these, 
two attitude surveys, a skills test, and a questionnaire, were developed 
by the Investigator and the fifth, the Purdue Teacher Oplnlonalre, Is a 
commercially available Instrument. 

Each ..nstrument Is discussed In terms of (1) purpose, (2) background 
Information^ (3> development and description, and (4) reliability and * 
validity If applicable. 

Statements Survey;, Teaching Reading In Content Areas 

Purpose ; An Instrument for assessing participating (experimental) 

and non*p&rtlclpatlng (comparison) teachers' attitudes toward Incor- 

poratlnft reading Instruction In the content areas was needed for use 

before and after the Intervention ^ .ogram (Inservlce workshops). 

Background Information : Sherlf and Sherlf (1969) state that 

attitudes can be Inferred from: 

what a person selects from the stimulus field out of so 
many stimuli available and how he evaluates them. Having 
angattltude becomes a matter of dcArce* rnthcr thnn an 
anror-»none affair. To the extent that a person consis- 
tently selects Items rexevant to the attitude and ^onsls-* 
tendy locates them within categories acceptable or 
objectionable to him, we may say that his attitude on the 
Issue at hand is stabilized (page 337) . 

*Thls chapter and the following are reprinted from Joyce W. Lee, Effects 
of Insarvlce Training in Reading on the Attitudes and Skills of 
Secondary Teachers and Adult Basic Education Teachers (unpublished 
dissertation, Pennsylvania State University, 1977). 

^ i 
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Shaw and Wright (1967) state that the most frequently used method 
l6t measuring attitude requires subjects to Indicate their agreement 
or dlsagreeraeat with a set of statements, a technique first developed 
by Thurstone (1929) and later modified by Llkert In 1932. An In- 
creasingly popular technique In attitude measurement Is the use of the 
semantic differential as originally developed by Osgood (1957). 
Because as Sherl^^^d-Sherlf (1969) suggest, there Is no consens>4S on 
the most appropriate type of scale to use for measuring attitudes. It 
ur^s decided to construct t^o Instruments for this Investigation using 
the more traditional and widely accepted Llkert scale format for the 
first and the newer Osgood technique for the second. 

The *-ikert technique has been used for measuring attitudes on a 
wide variety of topics. In Likert's original study, for example, the 
items used concerned attitudes toward Negroes. On a typical Llkert- 
type instrument, the subject is asked to respond to a number of 
statements by selecting one alternative, usually from a group of five 
to sev-n choices ranging from "strongly agree" to "strongly disagree" 
with one neutral choice such as "undecided" or "no opinion," Thus 
each item is a rating device which reveals both the direction (positive 
or negative) and the intensity (strong, moderate, neutral) the subject 
attaches to the statement. Each choice of the five to seven alter- 
natives is assigned a numerical value and an overall test score is the 
summated score of the choices made by the subject. A high score then 
is generally taken as an indication of an attitude close to one 
extreme and a low score, an attitude close to the opposite extreme. 

Sherif and Sherif (1969) make the following suggestions for scale 
construction using the Llkert technique: 
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!• Statements should be formulated on the basis of empirical 
• observations of different viewpoints on the Issue In 
questions* « 
2* Items should be clear-cut statements representing deflhlte 
favorable or unfavorable stands. 

3. An equal numbei of pro and con statements should be 
included. 

4. While statements on the scale should pertain to a single 
Issue, such a scale should not contain statements on which 
all persons In a sample will agree or disagree. 

5. Statements should pertain to desirable or undesirable 
behaviors or courses "^f action, not statements of fact. 

6. Scales should be tried out on a population similar to the 
Investigation sample and analysis of results conducted to 
eliminate Items which do not discriminate between high and 
low scoring subjects and those which do not correlate with 
total test scores. 

These six suggestions were utilized In constructing the Items In 
the Llkert scale used In this Investigation. 

Gardner (1975) cautions against attitude Investigations with llttie 
discernible relationship between the experimental treatment and the 
scale used to measure Its effects. The Investigator considered using 
a Llkert scale developed by Otto (1968) for assessing content area 
teachers' attitudes toward reading Instruction bit decided against Its 
use because the Items on Otto's scale do not reflect a diagnostic- 
prescriptive approach to teaching reading skills. As this is the 
approach stressed in the Inservlce program used as the experimental 
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treataent in this Investigation, it seemed wise to follow Gardner's 
advice and develop an instranent with a clear relationship to the 
experimental treatment. Tl^us the items for the Likert scale described 
here were constructed on the basis of the diagaostic-prescriptive 

approach to reading instruction as further described in the next 

ft. 

section. 

Development and Description : Using Sherif and Sheriffs suggestions, 
the investigator developed a pool of 35 statements though to reflect 
behaviors cr courses of action content area teachers might exhibit with 
regard to reading instruction in their classrooms. Approximately one- 
half of these statements were worded positively (for example, "It is 

desirable that teachers ") and one-half worded negatively (for 

example, "It is not desirable for teachers "). Approximately 

one-half of the statements were thought to describe behaviors or courses 
of action characteristic of diagnosis of reading ability and the other 
items to describe prescriptive strategies for utilizing diagnoses. 

The 35 statements were presented to two university professors who 
teach courses in reading instruction and to several content area 
teachers in an attempt to establish content validity. Based on the 
independent judgments of these professionals, the 24 statements which 
most rated as valid were selected for the preliminary instrument. 

Two minor revisions were made before field-testing this instrument. 
First, the term "content area" was deleted from each item and instead 
placed in the directions with the explanation that the term teacher(s) 
in each item, was to be interpreted as meaning a teacher in any of the 
content areas such as English, social studies, math, science, music, 
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health education, hone economics, etc. Second, some rewording was 
necessary in order that an equal number of positive and negative 
Iteas could be retained. This rewording did not affect the content 
of any stateaent since In the scoring of Llkert Items, negatively 
worded Items are scored In a reverse manner so as to make ^11 response 
values equivalent. The purpose of Including such negatively worded 
statements Is to minimize the effects of response set. 

The 24 Item scale stf const rue ted^was Initially field-tested on 
a total of 67 teachers at tvo sites, representing as closely as 
practical the sample to be used In the Investigation. All were content 
area teachers In secondary schools In central Pennsylvania, about half 
of them In a rural school and the other half In an urban school. M6st 
of the teachers had no background experience or coursevork in reading 
Instruction, and their range of teaching experience was from one to 
twenty- five years. 

Reliabili ty and Validi ty: Table 1 presents the results obtained 
In the field testing of this Instrument. Following Sherlf and Sherlf's 
suggested procedure? for establishing reliability, the test scores were 
analyzed on two dimensions. First, the coefficient alpha reliability 
formula was used as a measure for establishing Internal consistency. 
•On the original 24 Item scale, this reliability estimate Is .85. Second, 
Items with the lowest adjusted Item-total correlations were deleted and 
revised reliability coef f lcj«!nts were computed based en the remaining 
Items. It was ultimately decided that the four Items with adjusted item- 
total ^.orrelatlons below .35 could be deleted with little effect on 
reliability. Appendix A lists the 20 items retained on the final 
instrument. This final version has an estimated reliability of .84. 
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TABLE 1 

RELIABILITY ESTIMATES FOR STATE>fEKTS SURVEY 



Possible Range Actual Range Coefficient 

H of Scores of Scores M SD Alpha 

Urban TewChers 34 24-120 65-114 97.00 11.12 .78 

Rural Teachers 33 24-120 53-120 98.82 15.90 .88 

Total 67 24-120 53-120 97.90 13.71 .85 



HOTE * These figures are based on the original 24-ltem scale. 
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A second reliability study to estimate stability across time was 
conducted using a group of 32 graduate students enrolled In courses In 
Curriculum and Instruction and Educational Administration at the 
Pennsylvania State University. A Pearson product moment correlation 
betveen two test administrations was computed. The twenty item 
version of the Statements Survey has a test retest reliability of 
•57 with a two week Interval. 

It is of Interest to note that while the use of the diagnostic- 
prescriptive format was useful for conceptualizing item construction 
and does take into account Gardner's admonition to relate the attitude 
scale to the experimental treatment « such as approach to test con- 
struction in this case did not yield, as originally hoped, two distinct 
subscales. The correlation between the items considered diagnostic 
and those considered prescriptive by the investigator and content 
Judges is .77. As these two set.n of items are so highly correlated, 
it was declced to Use only a total score in analyzing the data in the 
study. 

Content validity has been considered under test development. 
Another field testing was conducted in order to establish evidence 
for construct validity for the Likert scale attitude survey. The 
instrument was administered to 32 graduate students enrolled in an 
advanced practicum in developmental and remedial reading at The 
Pennsylvania State University. All were candidates for advanced 
dsgrees in reading: all reported teaching experience ranging from 
one to eleven years and completion of a minimum of six graduage credits 
in reading. The majority of this group in fact reported 12 or more 
advanced degree credits in reading courses. It was felt that such a 
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group differed substantially from the teachers who had completed the 
instrument as part of the previous field testing program. It was 
hypothesized that the graduate students would score significantly 
higher on the instruMnt if In fact the statements represented be- 
haviors or courses of action toward which persons trained in reading 
instruction would express very positive attitudes. Table 2 presents 
the results of this test administration cocq>ared to the previous 
administration described. A statistically significant mean score 
difference batveen the groups is presented as evidence of construct 
validity for the instrument, ic (9.7) - 5.637. £ < .001. 

Situations Survey; Teaching Reading In Content Areas 

Purpose: As explained in the discussion of the development of 
the attitude survey, it was decided to use Doth a Likert scale and a 
semantic differential scale for measuring the attitudes of experimental 
and comparison group teachers in the investigation. It was hoped that 
the use of two different measures would increase the validity of the 
results obtained and would perhaps contribute evidence of the desira- 
bility of this approach to attitude assessment. 

Background Information ; Sherif ^nd Sherif (1^^69) point out that 
most situations arouse not one but a complex of attitudes, one of which 
is the respondent's views of the person asking the question or admini* 
stering the procedures in a research situation. Therefore, they 
caution, "adequate assedsment of attitude cannot be made if one ignores 
the stimulus situation in which the individual's attitude is aroused" 
(page 336). It is from this cautionary stance t\^a^: the question of 
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Graduate Students 32 
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direct versus indirect assessnent of attitude evolves. Askov (1970) 
has suggested that based on the findings of Weschler and Bemberg 
(1950) the value of any technique used to assess attitude may rest 
primarily on the way in which its intent is disguised. Weschlei: and 
Bemberg seem to suggest that the u^e of techniques such as direct 

questioning (for example, "What do you think of ?") and 

traditional scales of the Likert type may lead respondents to evade 
the Issue and answer according to what they consider the socially 
desirable answer. Askcv therefore suggests the ^dse of an adaptation 
of Osgood's technique as a somewhat disguised or indirect method of 
attitude assessment. Sherif and Sherif (1969) and Shaw and Wright 
(1967) do not conceptualize the semantic differential technique as 
an indirect measure but suggest that its advantage over a rating 
scale technique such as that of Likert lies in its yielding "finer 
gradations'* of the respondents' attitudes. 

Snider and Osgood (1969) have compiled a volume which includes 
approximately 50 frequently cited research studies which have utilized 
the semantic differential technique. They point out that since 
Osgood's introduction of the technique in 1957, as an outgrowth of his 
work on meaning, the semantic differential has become one of the most 
consistently used measurement techniques in psychology. They suggest 
that this has occurred for two teasons. First, the semantic differential 
was designed to get at a very important variable in human behavior; 
meaning. Second, the technique is very flexible. 

A review of a great number of studies in which the semantic 
differential technique is used suggests that relatively few studies 
have dfcalt with assessment of teacher attitude. Askov 's 1970 study 
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In which change in tloencary teachers* attitudes toward individualizing 

t 

/reading instruction has been cited previously. In this study a seomitic 
differential instruMnt was used. Butzov and Davis (1975) report the 
use of a scMntic differential scale for aeasuring teachers* attitudes 
toward teaching elementary science. 

Nunnally (1967) aakes five suggestions the test constructor should 
keep in aind in developing a scale using the seuntic differential 
technique: 

« 

1. One should seek a hoaogeneous group of adjective scales 
that aeets the requirements of reliability. 

2. Numbers should be assigned to designate the gradations 
on the scales and the meanings of those numbers should 
be defined and illustrated for the respondents (for 
example, on the scale "good-bad," a 5 means "slightly 
good," a 4 means "slightly bad," etc.) 

3. Rather than using the standard factors (i.e., adjective 
pairs) found in studies measuring diverse concepts, there 
is nothing wrong with developing particular groups of 
scales for particular purposes. 

4. There is an advantage in summing over a number of scales, 
rather than in relying on one scale alone for a concept 
in that, despite the likelihood of having different 
patterns of loading factors, such a summation will permit 
finer discriminations among persons. 

5. It is wise to compare concepts on individual scales in 
order to determine whether or not a particular scale 
provides useful information about each concept; in other 
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words, each concept should be coirsidered individually 
with each scale in test construction (pp. 542-543). 

The investigator^jistsd these guidelines in developing the semantic 
differential instrument described in the next section. 

DevelopMcn t and Description : Although often referred to as the 
semantic differential, Osgood's technique is not a test but a very . 
flexible way of getting at the meaning V^at a concept has for a person. 
Osgood, Succi and Tannebaum (1957) stress that there are no standardized 
concepts or standardized scales associated with the technique. Instead, 
the concepts and scales used for a particular instrument are determined 
by the purpose of the investigation. 

A semantic differential instrument consists of a set of concepts 
ranging from single words (for example, "God," "honesty," etc.) to a 
description of a behavior or a course of action one might follow. After 
each concept is a series of bipolar adjectives (for example, "good-bad," 
'*i^^T^-^nfaix,'' etc.) which the respondent is to rate, usually on a seven 
point scale, the mid-point of which represents a neutral attitude while 
the extreme points represent gradients of intensity from, for example, 
"very good" to "slightly good" to "not very good" and, at the other end 
of the scale, from "very bad" to "slightly bad" to "not very bad," 

When the respondent has rated a concept on such a series of 
bipolar adjectives, his attitude is inferred on the basis of both the 
direction and the polarity of his responses, A total score is either 
the total or the average of his ratings. Sherlf and Sherlf (1969) 
suggest that analysis of a score on a semantic differential instrument 
Isjbased on the assumption that the more extreme a person's rating, 
the more intensely he holds an attitude in the indicated direction. 
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In developing the s^tlc differential instrument the investigator 
constructed a pool of 30 items for possible inclusion in a preliminary 
instrument. The same professors of reading and content area teachers 
who assisted in validating the Likert scale items for the Statements 
Survey individually judged these 30 items and from these, 16 were 
selected on the basis of inter-rater agreement. Each item consists 
of a brief description of a classroom "situation" a particular content 
area teacher might be faced with and a possible "plan" which might be 
implemented in the situation. Each plan represents either a diagnostic 
strategy or a prescriptive strategy related to reading instruction in 
the content area specified. In addition to these 16 items, two items 
were constructed which are considered to be "poor plans" for content 
area teachers to utilize. These items were included to minimize res- 
ponse set. 

A series of bipolar adjectives was selected based on descriptive 
terms often used In the literature on content area reading, individualized 
instruction in reading, and diagnostic-prescriptive teaching. The 
instructions used are similar to those used by Askov (1970) which in 
turn are similar to those suggested by Osgood (1957). 

Two adaptations of the semantic differential scaie were made in 
the present study. Analysis of the three factors suggested (Osgood, 
Succi, and Tannebaum (evaluation, potency, and activity) was not under- 
taken since a unitary factor of attitude seemed more appropriate to 
the study than analysis of separate factors. Askov ri970) reports a 
similar adaptation of the technique. 

Another adaptation was the addition of two questions following each 
item on which the respondent was also to use bipolar adjectives, this 
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time to rate his answers to the questions. The first question, which 
is Che same for each item, asks Che respondent to rate the plan des- 
cribed id Che icea on the basis of its feasibility in the classroom. 
This question was included to account for Osgood's caution that the 
way one evaluates a concept does not necessarily reflect the way one 
behaves toward that concept. The investigator was interested in 
looking at how responses to this question correlated with responses 
CO the series of adjecci-'es ianedlacely following each icem. It was 
speculated that some teachers could have a very positive attitude 
coward Che plan described in an iCem buC would noneCheless raCe Che 
plan as noc very feasible in Che classroom. 

The second quescion following each ICem asked che respondenCs to 
race cheir "skill" in considering wheCher or noc chey could execute 
such a plan as the one described in the item. Of interest here is the 
consideration of how respondenCs' ratings on this question (from very 
skilled to not skilled at all) would correlate with their performance 
on the skills instrument to be described in the next section. It was 
speculated that as indicated in studies cited earlier, respondents 
might report themselves as more skilled than the skills instrument 
would indicate. 

It should be noted that the two questions included in the survey 
were scored , separately from the semantic differential Situations Survey 
Score and considered as two separate meausres, a Feasibility Score 
and a Perceived Skill Score. The Situations Survey scores and Feasi- 
bility Scores were used as two separate indications of subjects' 
attitudes toward the integration of reading instruction in the content 
area classroom while the Perceived Skill Scores were used as one 



40 



A. 5-15,. 



dimension M valuating ubjects' kill level as discussed in ''^"^ 
Chapter Four. 

Before field testing had' been completed on this preliminary 
instruaent, a content area reading consultant , who was brought in 
to represent the reactions of secondary teachers, made several, 
suggestions for revised item wording and suggested the inclusion of 
an additional adjective scale. It was decided to incorporate these 
ideas in a revised version of the instrument and to complete the 
field testing with this revised instrument. Nine of the 18 items . 
were thus changed and the bipolar adjective scale "desirable-un- 
decirable" was added for each item. 

Reliability And Validity; The revised version of the instrument 
vas field tested on a total of 35 inservice teachers. Again, as 
reported in the section on the Statenebts Surv-ty, the presumed subscales 
(diagnostic and prescriptive) correlated so highly with each other 
that it was decided to use only a total score as the instrument was 
apparencly not measuring two distinct concepts. On the basis of 
lowest adjusted item^otal correlations (coefficients lower than .39:, 
six items were deleted from the 18 item preliminary instrument, 
including the two^i^ems constructed as "poor plans" which did not work 
as planned, In addition, one set of adjectives (challenging- 
unchallenging) was dexeted for each plan on the basis of item-total 
correlatiob values. 

The final instrument, then, consists of 12 items with five sets 
of bipolar adjectives to be rated for each item. Using the coefficient 
alpha reliability formula, this 12 item instrument has an estimated 
reliability of .897. A coefficient alpha reliability coefficient of 
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.97 was obtained when each set of adjectives was considered as a 
separate scale, thus making this a 60 item instrument instead of a 
12 item one. However, it is more realistic to conceptualize the 
instrument as consisting of 12 items as it is questionable that each 
set of adjectives can be considered . be measuring a separate concept. 
Appendix B liecs the items on the final version of this instrument 

4rlth; the five sees pf adjectives th^t appear for each item. 

\ 

A group of 33 secbndary educatioit^students enrolled in an under- 
gradu^W course in content area reading^h^truction at the Pennsylvania 
State University was used in a test retest ri^iability study for the 

Sittt^ons Survey. Their scores were used in coinputing a Pearson 

\ 

Product Moment correlation for this instrument, Pr^nd post test 
scores were gathered with a one week interval and a test^ retest 
reliability estimate of .68 was obtained for the Si tuationV Survey 
scores, a .61 for the Feasibility Scores part of the instrument^ and 
a . ? for the Perceived Skills Scores part of the instrument, \ 

\ 

Evidence for construct validity for this semantic differential 
instrument is based on the administration of the survey to the same 
group of graduate students in reading as described for the Statements 
Survey. Again, it was speculated that this group of students would 
score significantly higher that the group of teachers oo whom the 
instrument had been previously field tested. Table 3 presents the 
data gathered in this construct validity study, A statistically 
significant mean score difference between the groups was obtained as 
speculated would occur, t^ (65) » 4,51, ^,001, \ 
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TABLE 3 

SITUATIONS SURVEY 

MEAN SCORES OF SUBJECTS WITH DIFFERING 
BACKGROUNDS IN READING INSTRUCTION 



Possible Range Actual Range 

of scores of scores M gfi 



Public 

School Teachers 35 60-420 196-420 332.88 55.58 
Graduate Students 

in Reading 32 60-420 250-417 383.38 34.48 

IWTE, These figures are based on the responses to the retained 12 items 
only. 

\ 



Skills Test 

Purpose: Because one of the dependent variables to be considered 
in the investigation was change in the diagnostic-prescriptive skills 
levels of teachers participating in the workshop program, an instrument 
Was needed for measuring such change. 

Backgroun d Information : As noted in reviewing investigations aimed 
at helping content area teachers develop skills in reading instruction, 
few attempts have been made to measure the pre and post skills levels 
of teachers involved. No appropriate instrument was located which would 
serve the purpose of the present investigation. 

Glaser (in Bro%m, 1976) makes an important distinction between norm- 
referenced and criterion«.referenced tests: 

On a norm-referenced test, performance Is interpreted by 
comparing a given individual's score to that of a relevant 
comparison group. Thus, interpretation involves a statement 
of the person's relative ranking within a norm group. 
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Scores on criterion-referenced tests, in contrast, are 
interpreted in terms of specified performance standards. 
That is, an ii Jividual's performance on a test is com- 
pared, not to the performance of other people, but to 
some standard of proficiency or mastery of the material 
covered by the test. Usually, this standard is defined 
in terms of degree of mastery of the test material ~ 
that is, in terms of the test content. Such scores are 
therefore content-raf erenced (p. 202). 

AbIcov, Kamn, and Klumb (1977) have suggested that criterion- 
referenced assessment instruments are the more appropriate of the two 
types described for measuring teacher skill levels since the purpose 
is measurement of skill attainment rather than comparison with a 
normative group. One of the purposes of^^h^Jut^ervention of this 
Investigation is the development and/or improvement of teachers' 
skills in using diagnostic-prescriptive instructional techniques in 
the content areas. Brown (1976) has suggested that criterion-referenced 
scores are appropriarj when what is to be measured is achievement. It 
therefore seems s^pproprlate, based on Glaser*s description and the 
suggestions of Askov and Brown, that a criterion-referenced instrument 
be utilized to measure the level of teachers* skills in diagnostic- 
prescriptive technic jes prior to the intervention and the changes, if 

any> that occur in these skill levels following the intervention. 

\^ 

Brpwn (1976) specif ies^two steps that should be followed in 
developing ^^ criterion-refereifced instrument. First, the content and/or 
skills domain to be covered by the test must be specified. Second, a 
scale on which te§t performance can be reported must be generated. He 
cautions that specifyl^ng the domain covered by the test is not always 
as straightforward as some suggest. He suggests that the use of be- 
havioral objectives is perhaps the best approach to this problem In 
generating a scale on which test performance can be reported, Brown 
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suggests three alternatives: (1) mastery scores, (2) percentage correct 
standard scores. While each type of score presents its own problem of 
interpretation because of the difficulty of establishing evidence of 
validity. Brown suggests that the simplest approach to scoring a 
criterion-referenced test is to establish an arbitrary "mastery" level 
which is intetpreted as meaning that this level is the minimal level 
of performance needed tc proceed to the next level or concept. Brown 
points out that there is preliminary evidence, as presented by Bloom 
and others, that mastery level is generally in the range of 80Z to 
90Z correct responses. 

Developme nt and Description ; Brown's suggested steps and cautions 
for developing a criterion- referenced instrument were followed in the 
construction of the skills test described here. 

The investigator worked with the project directors in order to 
reach consensus in specifying the skills domain to he covered by the 
test. Ir was decided that the most rational approach to item development 
was to/use Brown's suggestion regarding behavioral objectives. Because 
the ex^rimental treatment was to be a series of workshops in which the 
participants would be required to meet specified objectives, these 
objectives were used as the content of the items for the instrument. 
For each objective of the workshop sessions, two or three items were 
written which were thought to measure attainment of that objective. 
From a pool of approximately 30 items. 24i were selected for field 
testing on the basis of inter-rater agreement. 

It was decided to use a mastery score of 80Z for reporting test 
performance. As Brown (1976) points out, use of such a score means 
that we are only interested In whAfhAr subjects att in an arbitrarily 
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selected standard or not. In other words, subjects who score at the 
80Z level or above are not differentiated and llkewls-e, there Is no 
differentiation between the subjects who sccre at the 79Z level and 
those who score, for exa^>le, at the 36J level. What we are interested 
in is how aany attain what is established as MStery and how many do 
not. Of particular interest in the present investigation is whether 
or not the experimental treatoient has any significant effect on the 
percentage attaining this mastery level before and after the workshop 
sessions. 

Reliabilit y and Validity : The 24 item skills instrument was 
administered at the beginning and end of the 1976 summer terra session 
to 20 Pennaylvania State University graduate students in education 
with teaching experience ranging from zer^ to seven years in a wi'de 
variety of subject areas. These students were enrolled in a course 
emphasizing principles and methods in the teaching of reading. Some 
of the topics covered in this class were ones which the project work- 
sfiops would include. Pre and post test scores of these twenty students 
were examined in order to judge the effectiveness of the 24 items in 
assessing changes produced by the course, a pass/fail pre to post 
test matrix was considered for each item in order to evaluate two 
aspects of what Popham (1975) describes as descriptive validity. First, 
it was desirable that a large number of subjects fail the item on the 
pretest in order to establish that there was room for improvement during 
tnc course of "treatment" (the reading course). Second, it was desirable 
that a reasonable number cf these subjects pass the item on the post- 
test as an indication of improvement after receiving the "treatment/* 
Table 4 presents sample matrices used for this two-dimensional analysis. 
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TABLE 4 



SAMPLE COKTZNT VALIDITY MATRICES FOR SKILLS TEST 



Pass 
Pretest 
Fall 



I ten 24 
Post test 
Pass Fall 



Itea 22 
Posttest 
Pass Fall 



8 


0 


Pass 


4 


6 






Pretest 






12 


0 


Fall 


0 


10 



NOTE. The figure In each cell represents the number of subjects out of 
the sample of 20 scoring In that cell. 



On Item 24 of the preliminary Instrument, for example, 12 subjects 
(or 602 of the sample of 20) failed the Item on pretesting, indicating 
that there was room for improvement on the concept measured by that 
item. On the posttesting, the same number of subjects, 12 (or 60%), 
passed the item, indicating that perhaps the treatment had been 
beneficial and providing evidence of the validity of that item. On 
the basis of thete considerations, 3 of the 24 items appeared to be 
ineffective in assessing change brought about by Instruction or 
treatment. One of these items was eliminated and the other two were 
revised based on the suggestions of the reading instruction professors 
originally used in validating the Instrument. 

This instrument was also submitted to a content area reading 
consultant brought in to help in the planning of the workshops and in 
the validation of Instruments to be used in the study. On the basis 
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of this consulcanc's suggestions, several revisions In wording of the 
retained items were made. One other change was nade at the suggestion 
of chls consultant, the addition of a fifth alternative answer choice, 
"I honestly don't know" for each Item. 

An attempt to assess reliability of Items was made using the same 
pass/fall pre-postte^t matrices as shown In Table A based on the suggestions 
of Hess (1973). For each Iteu, the sum of the proportion of subjects 
passing the Item on both pre and post test and the proportion falling 
the item on both pre and posttest was considered to Indicate the 
minimum reliability. To the extent that the treatment (the reading 
course) was successful, one would expect the "actual" reliability to 
exceed that value. The proportion of subjects passing pretest and 
failing posttest was considered to indicate the minimum unreliability. 
Assuming that the treatment did not have any true detrl<iental effect 
on the subjects' knowledge in this area, this minimum unreliability 
reflects a celling on the possible reliability estimate for that item. 
The matrix for Item 22 in Table A is an example of an item considered 
to have a low reliability based on this approach. While a total of 
ten subjects (or 50% of the sample) passed the item on pretesting, 
only four of these subjects (20Z) also passed it on posttestlng. 
%rhile six of them (30Z) failed the item they had passed ten weeks 
earlier. A consideration of the pass-fall/pre-posttest matrices for 
all 24 items on the preliminary Instrume X using this type of analysis 
also indicates the advisability of deleting or revising the same three 
items previously determined to be ineffective in considering validity. 
Thus a 23 item final instrument was decided upon and used in the study. 
This instrument is presented In Appendix C. 

ERIC 
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A test-reteat relLblllty estiaate was c<»puted for this lnstru«nt 
using pre and post test scores gathered with a two week Interval. 
Subjects for this reliability study were 17 students enrolled in a 
graduate curriculu. course at the Pennsylvania State University. Based 
on the scores of these subjects, a Pearson product mommt correlation 
of .80 was obtained. 

Questionnaire 

Pur£ose: In order to ev iuate the effects of the ijxperinental 
treatment, the inservice workshop program, it was necessary to devise 
a systea for collecting certain de«>graphic information fro. both the 
experimental and comparison group teachers. The investigator wished 
to obtain inforMtion on such independent variables as years of 
teaching experience, educational background, and content area taught 
in order to consider how these variables correlated with changes in 
skill and attitude, if such changes occurred. A questionnaire was 
developed for obtaining such information. 

Background Information ; Sax (1968) has suggested that there are 
two alternatives for obtaining de«>graphlc information from subjects 
in experimental research, the questionnaire and the interview. While 
the interview may be the most desirable means for obtaining highly 
reliable and valid information, it is often not pr.ictlcal especially 
where large numbers of subjects are involved. Sax notes that there 
are two advantages of the questionnaire which make its use defensible 
in experimental research which requires the collection of demographic 
information. First, the use of the questionnaire is more economical 
than use of the interview in terms of both ti^e and money. Second, the 
use of th* questionnaire can be more standardized and thus responses 
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coMidered aore reliable. Sax cautions that such standardization is 
only cchleved if certain criteria are aec. For exaaple. respondents 
■ust be presented with the saw» set of questions or itew. and res- 
ponses aust be obtained under the saae type of conditions. If both 
these conditions can be set, tie questionnaire car be considered sore 
appropriate for educational research than the interview. 

Developaent and Des cription : The investigator selected the 
variables believed to be of value in considering the nature of any 
changes which alght occur in attitudes and/or skills among the subjects 
in the Investigation. Based on these variables a questionnaire was 
constructed which is presented in Appendix D. 

Purdue Teacher Opinionaire (PTO^ 

Purpose: An InstruMnt was needed to control for independent 
variables that aight account for changes (or no changes) in attitudes 
and skills aaong the experi»ental and coaparison teachers in the 
Investigation. 

Backgroun d Inf oration : The few studies which have addressed the 
issue of teacher attitude change, behavior change, and/or skill change 
as related to an intervention strategy have made no attempt to ronsider 
independent variables which might have had an influence on t.'ie changes 
(or lack or changes). It was speculated that teacher morale might be 
such a variable in that teachers with a generally low morale light be 
less likely to have initially positive attitudes or to change their 
attitudes tovard reading instruction. The Purdue Teacher Opinionaire . 
the pro, (Bentley and Remple, 1973) was selected as an instrument to 
control for this variable of teaching morale 
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Developaent and Description: The PTO vas developed at Purdue 
University as a aeasure of teacher morale. The authors suggest that 
the level of wrale la determined by the "extent to which an individual's 
needs are satisfied and the extent to which the individual perceives 
satisfaction as sCemlng from the total job situation. High morale is 
evident when there is interest in and enthusiasm for the job" (page 6). 

The first form of the PTO was developed in 1961. The version used 
in this investigation is a 1970 revision which contains 100 items 
representing ten categories (e.g., "Teacher Rapport with Principal." 
"Teacher Status," "School Facilities and Services"). Ench item is a 
statement about persons and/or things in the environment related to 
morale. The respondent is to make a judgement or express his or her 
feelings about each statement on a four point scale. Responses are 
weighted and quantified so that a total score is assigned to each 
respondent which is reported as an index of the person's morale. 

Reliabilit y and Validity ; The original Instrument was administered 
experimentally to a sample of high school teachers. Based on internal 
consistency item analysis techniques, a final choice of items was made. 
This 1961 version consisting of 145 items in eight categories is re- 
ported to have a Kuder-Rlchardson estimated reliability of .96. It 
was validated through a procedure in which responding teachers were 
asked to name several teachers on their faculties whom they considered 
to have the "highest BX}rale" and several they considered to have the 
"lowest morale." On the basli of these peer judgements, "high," 
"middle." and "low" teacher morale groups were identified and mean 
PTO scores were calculated for each group. Bentley and Reraple (1961) 
report that differences among the three groups were in the expected 
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direction and statistically significant, providing evidence of 
construct validity for the instrument. 

Factor analysis of che 1961. version of the PTO was undertaken 
to determine whether or not, as posited by Bentley and Remple, teacher 
morale is in fact multi-dimensional. Their investigation of this 
question resulted in the identification of ten factors and on the 
basis of the factor analysis study, the PTO was revised in the current 
form which contains 100 items in ten categories. The PTO is available 
from the Purdue Research Foundation, West Lafeyette, Indiana. 

Bentley and Remple (1973) report a test-retest (four week interval) 
correlation for total scores on the revised edition of .87. In 
anoth r validation study, this tlae using the revised edition, prin- 
cipals were asked to respond to the items as they thought faculty 
meiAers would respond. Further evidence for the validity of the PTO 
was established in that differences between the median scores for 
faculty members and those for the principals were not significant. 

One recent addition to the technical data available to users of 
the PTO is expansion of the normlng groups reported. Of particular 
interest for this investigation is the inclusion of separate norming 
information for junior and senior high school facilities. 

Selection of the Sample 

In selecting the snmple to be used in this investigat lor. , the 
project directors recognized the desirability of including a diversi- 
fied group of teachers in order that results of the Investignt ion miRht 
be generalized to a variety of other populations. For this reason, the 
grant proposal included a committment to provide Inservice training in 
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school systens representing three different geographical areas, one 
urban, one rural, and one suburban. A number of sites were considered 
and rejected on the basis of state definitions of urban, rural 4nd 
suburban . The New Middle School In Harrlsburg, Pennsylvania, was ^ 
selected as the urban site; the Fenns Valley Junior High Schoof , In 
Spring Mills, Pennsylvania, was selected as the rural site; and the 
Park Forest and Westerly Parkway Junior High Schools In State College, 
Pennsylvania, were combined as the suburban site. Adult Basic Education 
teachers in Harrlsburg were invited to participate as part of the urban 
sample and Adult Basic Education teacher in State College and surrouiuiing 
areas were invited to participate as part of either the suburban or 
rural sample. 

The project directors met with the principals and other admlnls- 
tratlve personnel at ^ach site to describe the project to he undertaken 
during the school year 1976*77. Meetings with the faculty and staff 
were also arranged so that direct discussion with the project directors 
could be held. All faculty members and staff at each site were accorded 
an opportunity to volunteerjfor participatior*^ in the project. Graduate 
credit (up to six credit hours) was arranged at the teacher's option 
through The Pennsylvania State University, Department of Continuing 
Education. In addition, a modest honorarium per workshop was offered* 
Staff and administrative personnel who indicated a desire to participate 
were encouraged to do so iiv^dditlon to the regular faculty members who 
were the target grdup for the project. These other participants (non- 
faculty members) would be eligible for credit but not for the honorarium 
under terms of the grant funding the project. These stipulations were 
based both on The Pennsylvania Department of Education guidelines and the 
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suggestions made by Otto and Erlkson (1973) and Axelrod (19 75) for 
maximizing the value of inservice education. 

Because randomization of sample is not feasible in a situation 
such as the one just described where "volunteers" are recruited and 
all who volunteer are accepted, it was not possible to establish true 
control groups. As it was nonetheless desirable in the design of the 
study to make some provision for comparing results according to 
differing groups, Stanley and Campbell's (1963) suggestion for non- 
equivalent control or comparison groups was followed. Principals at 
the selected sites were requested to approve and arrange the scheduling 
of pre and posttesting sessions for their total faculties so that all 
personnel who were to participate in the workshops plus those not 
electing to participate would be included in the data gathering process. 
It was explained that an attempt would be made to keep the identities 
of individual persons anonymous through the use of numeric aliases which 
only the investigator could match with a. subject's name. This identi- 
fication was deemed necessary in that not only pre and posttest scores 
would be matched in the analysis of data but also detftographic data 
gathered at tKe pretest session, information from intervening observation 
of instruction, and evaluenions of materials developed by workshop parti- 
cipants. According to terms of a protocol prepared for and approved by 
The Pennsylvania State University Committee for the Protection of Human 
Subjects, an informed consent form was to be filled out by each parti- 
c/pant in the workshops as well as those comprising the comparison groups 
Comparison teachers were paid a small honorarium for their cooperation 
in the data collection process. 
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Treatment 



The experlmenttfX treatment consisted of two types of intervention. 
First 9 a series of fifteen inservice workshops was planned for the school 
year 1976-7"^ -h ot which would focus on one or more aspects of a 
diagnostic:-: .tjscriptive model^for dealing with reading instruction within' 
the content ^area classroom* The second type of Intervention consisted 
of providing each site with one or more graduate assistants trained in 
reading who would provide on site consultant services aOfd would observe 

the extent to which the techniques described in the workshops Merk 

/ 

implemented in the classroom. 

Ipservice Workshop Program 

The selection of topics for the inservice workshops was based on 
these three considerations: (1) the recommendations of Otto and T: ikstJn 
(1973) and tho^e of Axelrod (1975) for successful inservice in reading; 
(2) the reports of the content of several of the inservice programs 
described in Chapter Two; and (3) the experience of one of the project^ 
directors with a course offered in resident instruction at The Pennsy- 
lvania State University (Fall, 1975) which was considered a pilot^f 




the content of the project workshops. The workshop topics are inclutfi^d \ 
in Table 5. 

Teachers participating in the workshop program had three options. 
They could register for six graduate credit^ through Continuing Education 
at The Pennsylvania State University, register for three credits, or they 
could simply attend the workshops, not registering for any graduate credits. 
Those ^registering for credit paid the standard Pennsylvania State 
University tuition fe^. 

/ 
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Workshop participants registered for ""six credits were expected to 
CQpplete all of the 13 objectives outlined In Table 5. Those registered 
for three credits were expected to complete the first 12 of these 
objectives. Final grading for those registered for credit depended upon 
the satisfactory completion of the required objectives as judged by Che 
on site consultants. 

It was hoped that these teachers participating In the workshops but 
not registered for graduate credit would also complete most of the 
objectives. As an Incentive, these teachers would receive a certificate 
Indicating that they had successfully completed a course In content area 
reading If they satisfactorily completed objectives one through nine 
plus objectives eleven and twelve. Those non credit workshop partici- 
pants compU.'ng fewer than these objectives would not receive the 
certificate. 

On Site Consultants 

Four Pennsylvania State University graduate assistants served as 
on site consultants. These assistants were selected on the basis of 
the. r experience In secondary educate and their background in 
reading. The assistants attended orientation sessions prior to the 
first workshops during which they were introduced to the concepts to 
be covered in the workshops and given suggestions for working with 
content area teachers. During one of these orientation sessions, a 
consultant with experience in training content area reading teachers 
in various Inservice programs shared her experiences with the staff 
of the project and offered suggestions as to how the on site 
consultants might be of the most benefit tc the workshop participants. 
During subsequent orientation sessions, another consultant helped the 



TABLE 5 

WORKSHOP OBJECTIVES AND CORRESPONDING WORKSHOP TOPICS 



Workshop Objective 



Workshop Topic 



Each teacher will demonstrate understanding of 
informal diagnosis by creating two informal 
diagnostic procedures. 

Each teacher will use the results of diagnostic 
procedures to develop grouping patterns or ot^er 
classroom management plans. 

Each teacher will develop three alternative 
instructional procedures » a unit, a learning 
activity packet, and a lesson or longer in- 
structional plan using a medium other than 
reading. 

As part of a content area group (or 
individually), each teacher will develop 
an annotated bibliography of teaching 
materials in his/her content area. 

Each teacher will demonstrate understanding 
of linguistically and culturally different 
students by outlining tb^..«iaJor language 
problems faced by black ^d Appalachian 
students and describing in essay form one 
dialect or linguistic problem with three 
ways to work with it in the classroom. 

Each teacher will develop five exercises to 
reach reading skills in his/her content area, 
at least one of which will emphasize a skill 
in each major skill area of vocabulary, 
comprehension and study skills. 



Informal and formal diagnosis of 
reading ability. 



Informal and formal diagnosis of 
reading ability. 



Strategies tor instructional 
organization. 



Selecting appropriate materials. 



Language development and differences 
related to the reading process. 



Vocabulary development, teaching study 
skills, and levels of cognition. 



\ 



TABLE 5 (cont'd) 



Workshop Objective 



Work.ihop Topic 



17 



18 



19 



Each teacher will demonstrate hid/her ability 
to write comprehension questions at differing 
levels by writing at least six questions on 
one plecs of reading, using at least two levels 
of questioning. 

^ Each teacher will Identify paragraph functions 
for each paragraph In a piece of reading In 
his/her content area* 

- Each teacher will deaonstrate understanding 
of the concept of readability by applying at 
least two readability formulas to three texts 
In his/her content area and by writing a 
critical evaluation of the effectiveness of 
readability measures In his/her content -^rea. 



110 * Each teacher will develop a case study which 
follows one or more students over the length 
of the workshops and Includes use of 
diagnosis and some prescriptive Intervention 
based on that diagnosis. 

#11 - Each teacher will demonstrate his/her ability 
to apply content area reading principles by 
teaching at least three lessons Including 
content area reading skills, observed by a 
project staff member and discussed in a 
follow-up session. 



Levels of questioning for reading 
comprehension. m 



Critical reading. 



Readability of content area materials. 



Informal and formal diagnosis of 
reading ability. 



Utilizing directed reading activities 
In the content areas. 



ERIC 



TABLE 5 (cont'd) 



Workshop Objective 



Workshop Topic 



#12 - Each teacher w^ll keep a weekly logbook of 

activities and lessons Involving content area 
reading in at least one class. 

#13 - Each teacher will present to his/her workshop 
class a report or demonstrition of one of 
his/her teaching experiences using a content 
area reading practice discussed in the 
workshops. 



Utilizing directed reading activities 
in the content areas. 



ERIC 
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staff develop a systematic observation form to use when workshop teachers 
requested that the consultants visit their classroom for demonstration of 
various competencies. Training sessions in the use of this observation 
form were held as well as sessiotis during which' the staff practiced 
Judging the effectiveness of techniques they might observe workshop 
participai^ts utilizing in their classrooms. 

Once the project was underway, each assistant was required to attend 
the workshop sessions held at the site' to which he or she was assigned. 
In addition, these assistants were required to spend at least one day 
each week in the schools observing in the classrooms of workshop 
participants and meeting with these teachers to help them prepare materials 
and/or plan lessons utilizing ^lyr^chniques stressed in the workshops. 
Throughout the year the assistants met on a regular basis with the project 
directors in order to share ideas and co insure equal treatment pro- 
cedures across sites. 

Evaluation Procedures 

A total of seven sets of data were collected during the course of 
study. A description of the procedures followed for collecting each 
set of data follows. Table 6 presents this information graphically. 

Questionnaire 

Demographic information was collected from all ej.perimental teachers 
participating in the workshops and from those not participating who were 
considered to be the comparison group at each site. The questionnaire 
was filled out as part of the pretesting session at each site. 



Table 6 
DATA COLLECTTON PATTERN 



Type of DatA 


Experimental Teachers 


Comparison Teachers 


Questionnaire 


r 


X 


StateMents Survey 


X 


X 


Situations Survey 


X 


X 


Purdue Teacher Opinlonaire 


X 


X 


Skills Test 


X 




Teacher Lof^s 


X 




Classroom Observations 


X 





Note, An X Indicates that data was collected from the part of the sample listed in 
that column. 
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Statements Survey 

The Statements Survey was administered to all experimental and 
all comparison teachers at each site. This survty was administered 
as part of the pretesting jess ion and again at a posttesting session 
following the final workshop at the end of the project year. 

Situations Survey 

The Situatioi^ Survey was administered to all experimental and 
all comparison subjects at each site at both the pre and posttesting 
sessions. 

Purdue Teacher Opinionalre 

The Purdue Teacher Opinionaire described in Chapter Two was 
administered to all experimental and comparison group teachers at 
all sites as part of the pretesting session. This instrument was 
also administered as part of the posttesting session at the end of 
the year. 

Skills Test 

Tlie skills test described in Chapter Two was administered only 
to the teachers participating in the workshops. The test was 
administered during th€ first workshop session as a pretest and at 
the final workshop as a post test. 

Teft cher Logs 

Each teacher participating in the workshops was required to keep 
an informal log book in which was to be recorded any opportunity for 
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utilizing the techniques stressed in the sessions. Description of 
actual uses of such techniques were to be included as well as evaluations 
of the outcomes of such occurrences. Teachers were also to note the 
use of any aaterials suggested by the project directors in the workshops 
vith an indication of the effectiveness of such aaterials. Finally, 
teachers were to note the nature of any help they received from the on 
site consultants. These log books were to be used as self report data 
to provide additional information w^ich might help explain the effects 
of the treatment. 

Classroom Observations 

The on site consultants were required to make regular visits to 
the classrooms of the teachers assigned to them. These visits were 
to be made on the basis of mutual agreement hetween the consultant and 
the teacher so that feelings of pressure to perform were minimized as 
suggested by Otto and Erik<;on (1973) and also by Axelrod (1975). 
Teachers were encouraged to invite the consultants to visit their 
classrooms, for example, whenever they planned to "try out" one of the 
techniques suggested in the workshops. Follow-up meetings between the 
teachers and the consultants were to be scheduled so that feedback 
could be provided. The consultants were required to fill out an 
observation and consultation report for each of these scheduled 
meetings. The consultants also were required to assign to each parti- 
cipating teacher a pre or entry skill rating and a post exit skiil 
rating based on these classroom observations. Observation reports ,ind 
skill ratings were used as a means of getting an idea of how much effect 
the workshop sessions had on teacher behavior in the classroom. 
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The methods for analyzing the data gathered by the instruments 
described are presented with results in Chapter Four, 

Liaitations Of The Study 

While it is desirable to use control groups as described by 
Stanley and Campbell (1963) and Isaac and Michael (1974). this is 
frequently a difficult if not impossible technique to utilize on 
educational research. Campbell and Stanley (1963) suggest that in 
place of the Pretest Posttest Control Group Design in %rtiich subjects 
are assigned randomly to experiiwntal and control groups from a 
common population, it is quite legitimate to utilize what they label 
the Fkm-equivalent Control Group Design in situations for "naturally 
assembled collectives" such as classrooms or school faculties where 
randomization of sample is not generally feasj^e^. Such a design, 
while not as ideal as the Control Group Design, is preferable to 
using a One-Group Pretest Posttest Design. For this reason comparison 
or non-equivalent control groups, consisting of faculty members at 
the project sites who chose not to participate in the workshop part 
of the project, are utilized in this study on th^ assumption chat 
they are as similar to the participating teachers (the experimental 
subjects) as availability permits, 

A second limitation of the present study is the matter of dealing; 
with student achievement. The 'iltimate aim of helping teachers develop 
skills necessary to incorporating reading instruction in the content 
areas is of course increased academic achievement among the students 
taught by these teachers. Consideration was given to pre and post 
testing the student population served by the experimental and comparison 
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group teachers In the study, particularly m the area of reading. 
However the project directors and staff concluded that expectation 
of significant gain In anj^rt of academic achievement which could 
be attributed to teacher participation in the Inservlce program was 
unrealistic. Singer (1972), who discusses this issue of student 
gain during an Inservlce program, suggests that a one year "treatment" 
is not a long enough period of time for significant student gain to 
occur. Therefore, it was decided to focus on teacher changes in 
attitude and skill and to recommend a follow-up study to examine the 
effects, If any, on student achievement during the year following the 
inservlce program. 
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CHAPTER IV 

PRESENTATION AND ANALYSIS OF THE FINDINGS 

Findings based on the data gathered as part of this investigation^ 
are presented under the following general headings: (1) characteristics 
of the junior high school teachers, (2) attitudes among the junior high 
school teachers, (3) morale levels among the junior high school teachers, 
(4) skill levels among the junior high school teachers, and'*(5) 
characteristics, attitudes, morale levels, and skill levels among the . 
teachers of adults. 

Characteristics of the Junior High School Teachers 
Differences Between Treac^ment Groups 

Based on the responses of 129 junior high school teachers (57 
experimental teachers and 72 comparison teachers) to the questionnaire 
described in Chapter Three, several factors emerge which provide a 
description of the population used in this investigation. In general, 
the teachers who comprised the experimental group did not differ 
significantly from the teachers in the comparison group on the factors 
covered by the questionnaire. Using chi sq'uare for comparison of demo- 
graphic data, on only three factors was a significant difference found 
between the two groups. Table 7 presents the frequencies and per- 
centages of total group responses for these three factors. On the 
first factor for which a significant difference was found, the 
experimental group reported significantly less tcaciiinR exporionec, 

both in terms of reported total years of teaching, X^(3) ^ 19.74, £<.001, 

2 

years teaching in their particular content area, Xf3) - 24.65, £ < .001, 
than did the comparison group. On the second factor for which a 
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Table 7 



Dteogriphlc Factors on Which Junior High Teacher 
Treatment Groups Differed Significantly 



Total 
Experimental Group 
n - 57 



Total 
Comparison Group 
n - 72 



V 

Factor One: Teaching Experience 
Tears experience In 
primary content area (£< .001) 

0-3 years 
4-7 years 
8-11 years 
12 - 15 years 
■ore than 15 'years 

Total years teaching 
experience (£<.001) 



0 - 
4)- 
8 - 
12 - 
BO re than 



3 years 

7 years 

11 years 

15 years 

15 years 



22 
25 
7 
1 
2 



18 
26 
5 
2 
6 



38.6 
A3. 9 
12.3 
1.8 
3.5 



31.6 
45.6 
8.8 
3.5 
10.5 



18 
15 

7 
7 
24 



12 
17 
7 
7 
29 



25.4 
21.1 
9.9 
9.9 
33.8 



16.7 
23.6 
9.7 
9.7 
40.3 



Factor Two: Level of Education 
(£<.05) 

high school graduate Q 

some college 0 

undergraduate degree 39 

master's degree 18 

doctorate 0 



0 
0 

68.4 
31.6 
0 



0 
2 
31 
36 

3 



0 

2.8 
43.1 
50.0 

4.2 



Factor Svjree: Content Arca(s) 
Taught (£<.05) 



science 



12 



21.1 



5.6 



ERJC 



V 
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significant difference was found, the comparison group also reported 
a significantly higher level of education than the M^rimental 
group, X^(l) - 5.70, £<.05. The third factor on which'^ie groups 
differed significantly was that of content area. A significantly 
greater percentage of experimental teachers reported that th^y taught 
science than did comparison teachers > X.^(l) » 5.53, £ <.(J5t It 
should be noted that the degrees of freedom reported do not i.iatch the 
numbers in the categories in Table 7 because categories were combined 
in several cases due to small cell frequoftcies. f^or all other content 
areas, percentages for the experimental and comparison groups-^H^not 
differ significantly. Table 8 provides a detailed analysis of the 
/'^makeup of both treatment groups with regard to content areas represented 
within each group. For example, a larger percentage of teachers in the 
exp'eyimental group (26. 3Z) reported that they taught English than in the 
comparison group (15. 3Z). Looking at what are traditionally considered 
the "major" content areas in secondary schools (English, social stud:ies, 
sciences, and math), it should be noted that substantially large 
percentages of teachers in both groups reported teaching in these areas. 
The next largest category for both groups is reading. As noted on the 
table, these categories are non exclusive; in other words, a teacher 
could report teaching in more than one content area. 

On the other factors covered by the questionnaire, no si^'.ni fic/inl 
differences were found between the treatment groups. In general, then, 
the treatment groups differed very little with regard to the kinds of 
demographic data gathered for this investigation. When the demo- 
graphic data were analyzed by rite (urban, suburban, rural), tre^itT.cnc 
group differences on the teaching experience factor held only for :.^c 
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Table 8 



Confenr Area(s; Represented by Junior High Teachers 
in Experimental and Comparison Groups 



Experimental Grc» p Comparison Group 



Cont^«.« Area: 



English 15 

Social Studies 10 

Science 12 

Math 8 

Health Education 2 

Home Economics 6 

Vocational Education 7 

Business Ed-^cation 2 

Special Education 3 

Consumer Education 10 

Reading n 

Music 2 

Art 3 

Foreign Language 4 

Bilingual Education 2 

Librarian 2 
Non Teaching Personnel 2 



26.3 11 15,3 

17.5 14 19-4 

21.1 4 5.6 

14.0 14 19.4 

3.5 3 4,2 

10.5 1 1,4 

12,3 7 9.7 

3.5 5 6,9 

5.3 5 6.9 

11-5 7 9.7 

19.3 9 \i2,5 

3.5 6 J 8.3 

5.3 1 1.4 

7.0 4 5.6 

3.5 2 2.8 

3.5 4 5-6 

3.5 8 11,1 



Note. Content area categories are non exclusive in that many teachers 
reported teaching in more than one ^tegory. 
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suburban, A. (2) =• 7.31, ?( J5, (for total years of teaching experience) 
and X (2) • 8.74, £<.05 (for years teaching in a particular content 
area), and rural, X^(2) * 7.31, £<.05 (for total years teaching 
experience) and Xf(2) - 12.44, £<.01 (for years teaching in a particular 
content area), samples^ For the second factor (level of education) and 
the third factor (content areas Caught), significant differences 
between treatment groups were not found ar individual sites. 

Experimental Group Characteristics 

Table 9 presents comparative dat ^ experimental teachers only on 
the variables of graduate credit, completion of workshop objectives, and 
workshop attendance. Figures are presented for the total experimental 
g;oup and for each of the three geographical sites separately. Teachers 
were considered experimental only if they attended at least ten of the 
fifteen workshop sessions. Any teacher for whom pretest and postcest 
data were available who attended less than three of the workshops was 
considered a comparison teacher ar well as teachers wmo attended i.one 
of the workshops but agreed to complete the pre and posttest instruments. 

Table 9 indicates that 35 of the 58 experimental teacheis, or 60%, 
elected i:o attend the wor*^shop sessions and earn either three or six 
graduate credits. At the urban si... ^ 86Z of the teachers elected one 
of the credit optfons while at the suburban and rural sites, 30Z and 
65X respectively chose to attend anu earn,««4it. 

Teachers electing to ^'ttend the fifteen workshops for r,raduate 
credit pljs teachers desiring to earn a |:ertificate of completion 

were expected to complete the first nine 6^jectives specified In 

/ 

fable 5 in Chapter Three. Thes»2 'line objectives represented what were 
considered skill levpl objectives. Tabjie 9 indicates that 32 of the 



Table 9 

CoKparlfocs Aaong Experla«ncal Junior High TftAchftrs on Variables of Craduaca Cra4ic» 
Coapladon of Workshop Objaccivas, and Workshop Accandanca 



Taachars 


Taachars 


local 


Taachars 


Cradle 


Hon 


Salacc- 


Salacr* 


taachars 


Salacc- 


(3-6) 


Crtd* c 


Ing 6 


ing 3 


Salccc- 


Ing Mon 


Taachars 


Taachars 


Cradle 


Craoii 


Ing 


Cradle 


Coaplac- 


CoMplac- 


Op c ion 


Op c loo 


Cradle 


Op c ion 


ing 


Ing 






Option 




Skill 


Skill 










Laval 


Laval 










Objac- 


Objac- 










civas 


civas 



Cradle 


Hon 


Cradle 


Hon 


Kaan 


Ha an 


(3-6) 


Cradle 


Taachars 


Cradle 


Nuabar 


Niabar 


Taachars 


(3-6) 


Cosplac- 


Taachars 


of 


Workshops 


Coaplac- 


Taachars 


ing Ail 


Earning 


Workshop 


Accandad 


ing 


Coaplac- 


Raqulrad 


Cercifi- 


Objac- 


of fos^ 


Applica- 


Ing 


Objac- 


- ta of 


civas 


sibla 13 


tion 


Applica- 


civas 


Lwapla- 


Coo- 




Uval 


cion 




tion 


placad 




Obj. 


Uval 






of pos- 




Obj. 






sibla 13 





All Sicas 

Co^in«d 31 4 35 23 32 3 33 6 31 3 9.48 13.51 

(n - 58) 



Crban Sica 

Only 17 1 18 ^ 15 I 17 2 15 I 1186 13 

(n - 21) 



Suburbjn SiCe 

Only 5IoU 625462 ".10 13.35 

(n - 20) 



tural Sice 

Only 9 : 11 6 11 0 11 0 11 0 9.47 14.18 

(n - 17) 



0 
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35 experimental teachers electing one of the credit options, or 91%, 



completed all of these skill level objectives. Analysis by site 



indicates that 832 urban, 100% suburban, and 1002 rural teachers 
electing a credit option completed the nine skills objectives. Of 
those teachers electing to attend the workshop sessions for no 
graduate credit, 3 of 23, or 13%, cot..rleted the skills obj ectives. 

Analysis by site indicates that 33% urban, 1A% suburban, and 0^ rural 

\ 

non credit teacl^rs completed these objectives, 

\ 

Teachers elcct^^ng to attend the workshops for credit as well as 

those atten'^-'ng in order to earn a certificate of completion were 

\ 

expected to complete objei^^tives 11 and 12 described in Table 5 in 



Chapter Three. These two objectives were considered classroom 

\ 

application Ifvel objectives. Of the teachers electing graduate 
credit, 33 of 35, r 94%, completed^ these objectives. By site, 94% 



urban, 83% suburban, and 100% rural teachers completed these class- 
room application objectives. Of those tethers electing neither 
credit option, 6 of 23, or 26%, completed tne^e object ;es, 3y site, 
66% urban, 29% suburban, j^j 0% rural teachers completed these 



classroom application objectives. 

Teachers electing the credit options were additiona^lly required 
to complete objective 10 (see Table 5 in Chapter Three) for J credits 
and objectives 10 and 13 (see Table 5 in Chapter Tlirce) for 6 cVedits. 



Successful completion of all required objectives by these teachers 



meant a B grade on the graduate transcript, an A grade assi^^nod if 



the on site consultants rated at least three of the objectives submitted 



as outstanding rather than satisfactory. (Successful completion of loss 



than the required objectives resulted in the lowering of a teacher's 
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grade by one grade par each unsatisfactory or unsubroltced objective.) 
Of the 35 experimental teachers electing one of the credit options, 
31, or 892, successfully completed the required number of objectives, 
831 at the urbnn site, lOOX at the suburban sjte, and lOOZ at the 
rural site doing so. 

Teachers attending the workshops and wishing only to earn a 
.certificate of completion (non credit teachers) were expected to 
complete all nine skill level objectives and the two classroom 
application objectives. Of the 23 non credit teachers, 3, or .13%, 
earned this certificate. 

Table 9 also indicates the mean number of workshop objectives 
(of a possible total of thirteen) completed by teachers at all sites 
(9c 48) and for each site separately (11.86 at the urban site, 7.10 nt 
the suburban site, and 9*47 at th** rural site). 

Finally, Table 9 indicates the mean number of v^t^.^hops (of a 
possible total of fifteen) attend^J by teachers at all sites (13.51) 
and for each site separately (13 at the urban site, 13.35 at the 
suburban site, and 14.18 at the rural site). 

Attitudes Among Junior High School Teachers 
Hypothesis number one in Chapter One states that within each site 
the positive relationship between group membership (experimental or 
comparison) and posttest performance on attitude measures vill be 
signifi cancly greater than the positive relationship between group 
membership and pretest perfonnance on these measures. 

Analysts of Attitude Change 

Hypothesis number one was accpeted. The experimental teachers' 
gains on the three attitude measures were significant W greater than 
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the gains of the comparison teachers. Thus, oh each of the three 
attitude measures, the relationship between group membership and 
performance on the posttests was greater than that relationship on 
the pretests. 

Table 10 piesents the observed or actual mean scores on the 
three attitude measures for all sites combined, for the urban site 
only, for the suburban site only, and for the rural site only. 

Analysis of variance using the RUMMAGE computer program at The 
Pennsylvania State University was used for a three way analysis of 
variance, A sites x treatment x time analysis was conducted on enrh 
of the three attitude measures. Tables 11, 12, ^nd 13 present the 
sufinary data for these analyses. 

On all three attitude measures no significant treatment main 
effect or site x treatment interaction effect was found. The fact 
that a significant treatment . mair effect was not found supports the 
assumption that the experimental and comparison groups were equivalent 
at the beginning of the treatment period despite the fact that teachers 
were not randomly selected for the treatment groups. The absence of 
a significant site x treatment interaction effect further supports 
groups' equivalency and establishes that the groups did not differ 
significantly at any of the three sites at the beginning of the 
treatment period, 

A significant time main effect was found with post test scores for 
the total sample (teachers in both treatment groups ai all sites) 
higher than pretest scores (£ <,05 on Statements Survey and £<,001 on 
Situations Survey and Feasibility scores). However, there was also a 
significant time x treatment interaction. Examination of cell means 



Table 10 



Pre and Posttest Observed Mean Scores of Junior High Teachers on Attitudes Measures 



Treatment Groups Combined: 


All Sites 


Combined 


Urban Site Only 




dXLc uniy 


Rural Site Only 




Pre 


Post 


Pre 


Post 


Pre 


Post 


Pre 


Post 


Statements Survey Scores 


85.^0 


87.28 


83. 78 


86. 29 


88.29 


88.59 


83.49 


86.67 




(n-129) 


(n''129) 


(n-41) 


(n-41) 


(n-49) 


(n-49) 


(n-39) 


(n-39) 


Situations Survey Scores 


348.17 


366.68 


349.76 


358.50 


354.69 


373. '69 


338.44 


366.77 




(n«129) 




(n»42) 


(n-48) 


(n-48) 


(n-49) 


(n-39) 


fn-39) 


Feasibility Scores 


65.10 


71. 30 


63.57 


69.36 


67.25 


72 71 


64.10 


71.62 




(n-129) 


(n-130) 


(n-42) 


(n-42) 


(n-48) 


(n-49) 


(n-39) 


(n-39) 


Experimental Groups Only: 


















Statements Survey Scores 


86.06 


90.78 


84.62 


91.81 


88.90 


92.05 


84.53 


88.00 




(n«58) 


(n-58) 


(n=21) 


(n-21) 


(n-20) 


(n-20) 


(n-17 


(n-17) 


Situations Survey Scores 


346.96 


374.90 


OAT AO 
J*# / . ** J 


JDO . yj 


351.68 


377.00 


1 1 O 


379.88 




(n-57; 


(n-57) 


(n«21) 


(n-21) 


(n-19) 


(n-19) 


(n-17) 


(n-17) 


Feasibility Scores 


63.63 


73.14 


62.24 


72.19 


66.0 


74.05 


62.71 


73.29 




(n-5/ ; 


(n 57) 


(n»21) 


(n-21) 


(n-19) 


(n-19) 


(n-17) 


(n-17) 


Comparison Groups Only: 


















Statements Survey Scores 


8A.86 


84.10 


82.90 


79.57 


87.86 


86.21 


82.68 


85.64 




(n-71) 


(n-72) 


(n-20) 


(n-21) 


(n-29) 


(n-29) 


(n-22) 


(n-22) 


Situation^ Survey Scores 


3A9.13 


360.25 


352.10 


347.86 


356.66 


371.97 


336.26 


356.64 




(n»72) 


(n'=72) 


(n-21) 


(n-21) 


(n-29) 


(n-29) 


(n-22) 


(n-?2) 


Feasibility Scor**s 


66.26 


69.79 


64.90 


66.52 


68. C7 


71.76 


65.18 


70.32 




(n-72) 


(n=72) 


(n-21) 


(n-21) 


(n-29) 


(n-29) 


(n-22) 


(n=22) 



Table 11 



Site X Treatment x Tine Analysis of Variance 
on Junior High Teachers* Statements Survey Scores 



Source 


ii 


MS 


F 




Sices 


2 


187.75 


1.16 


>.05 


TreacaenC 


1 


560.33 


3.47 


> .05 


Sice X TreaCnenC 


2 


100. C3 


< 1 


? .05 


Error (beCween Ss) 


123 


161.32 






Tine 


1 


282.06 


4. J6 


.04 


Sice X Time 


2 


34.25 


< 1 


> .05 


Treatnenc x Tine 


1 


388.22 


6.01 


.02 


Sice X TreaCnenC x Tiae 


2 


102.26 


1.58 


> .05 


Error (within Ss) 


123 


64.64 







Table 12 



Site X Treatment x Tine Analysis^ of Variance 
on Junior High Teachers' Situations Survey Scores 



Source 


df 


MS 


F 


£ 


Sice 


2 


347.25 


<1 


>.05 


TreaCmenC 


1 


9296.30 


3.91 


? .05 


Sice X TreaCmenC 


2 


1050.60 


< 1 


> .05 


Error (beCween Ss) 


123 


2379.90 






Tine 


1 


23,858.00 


?5.38 


< .001 


SlCe X Time 


2 


2205.50 


2.35 


> .05 


TreacaenC x Tln»€ 


1 


5135.70 


5.46 


.02 


Sice X TreatraenC x Time 


2 


341.90 




> .03 


Error (wichin Ss) 


123 


940.04 







Table 13 



Site X Treataent x Time Analysis of Variance 
on Junior High Teachers* Feasibility Scores 



Source 


df 


MS 


F 


£ 


Site 


2 


20.08 


•: 1 


>.05 


Treatment 


1 


48.00 


< 1 


> .05 


Site X Treatment 


2 


12.25 


< 1 


^ .05 


Error (between Ss) 


123 


117.14 






Time 


1 


2658.50 


43.24 


•■ .001 


Site X Time 


2 


27.61 


< 1 


■ .05 


Treatment x Time 


1 


574.53 


9.34 


< .01 


Site X Treatment x Time 


2 


22.70 


.1 


- .05 


Error (withing Ss) 


123 


61.49 







A, 5-52 

showed that, for each measure, either the comparison group did not 
improve significantly while the treatment group did (on Statements 
Survey and Situations Survey) or the comparison scores also increased 
but not so much as those of the experimental group (Feasibility 
scores). In other words, the gains made by the experimental groups 
were significantly greater than those by the comparison groups. The 
non significant site x treatment x time interaction indicates that 
the time x treatment effect held across all sites. In other words, 
there were no significant differences by site. 

Table 14 presents the estimated mean scores (adjusted for unequal 
n*s) on all three attitude measures only for those factors Oi. which a 
significant effect was obtained* On all three attitude measures the 
posttest experimental group mean scores are the highest and are 
significantly higher than the other three mean scores cited. 

Correlations Among Attitude Measures 

Tables 15, 16, and 17 present the correlations among the pre and 
posttest scores on the three attitude measures for botfj treatment 
groups at all sites combined and for the three sites separately 
(Table 15) and for each treatment group with all sites combined 4nd 
separately (Tables 16 and 17). Close examination of these tables 
provides information about how closely related teacher responses were 

between and among any of the attitudinal measures. Table 15, for 
example, indicates that the highest correlations for botli treatment 
groups combined occurred between posttest Feasibility scores and 
posttest Situations Survey scores, ranging from .85 at the rural sitp 
to .88 at the suburban site. Feasibility scores and Situations 
Survey scores were also highly correlated at pretest, ranging from 

ERLC 
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Table 14 

Estivated Mean Scores of Junior High Teachers on Three Attitude Measures 



Pretest 



Experimental 
Group 



Statements Survey Scores 
Time 

Treatment x Time 



88.30 



Comparison 
Group 



83.71 



All Experimental 
Teachers Group 



86.00 



92.90 



Posttest 

Comparison 
Croup 



83.34 



All 
Teachers 



88.12 



Situations Survey Scores 
Time 

Treatment x Time 



353.19 



341.87 



347.53 



381.73 



352. M • 



367.02 



Feasibility Scores 



Time 

Treatment x Time 



64.03 



65.52 



64. 78 



73.56 



69.00- 



71.28 
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Table 15 

Correlation Among Three Attitude Measures for 
Junior High Teacher -^Treatment Groups Combined 



Pretest Scores: 



All Sites Combined 

Situ- Feasi- 
ations bility 
Survey Scores 



Urban Site Only 

Situ- Feas^- 
ations bility 
Survey Scores 



Suburban Site Only 

Situ- Feasi-^ 
ations bility 
Survey Scores 



Rural Site Only 

Situ- Feasi- 
ations bility 
Survey Scores 



Statements 
Survey 



.39 



.35 



.27 



.31 



38 



.36 



.A9 



37 



SiXuat iopfi 
Survey 



.71 



,74' 



.78" 



.60 



Pf>stcest Scores: 



St areraent s 



.23' 



15 



.20 



10 



10 



.06 



38 



.30 



,'1 1 t ions 



.86 



.86 



.88 



.85 



Berri.i.e ..f incomplete data, n' s range from 126 - 130 for all sitw-s combined, 38 - 42 for the urban site. 

4*- - /*9 tjt the subii^han site, and 38 - 39 f'^r the rural site. 



Table 16 



Correlations Among the Three Attitude Measures 
for Junior High Teacher Comparison Groups 





All Slcee 


Combined 


Urban Site Only 


Suburban 


Site Only 


Rural Site Only 


Pretest Scores: 


Situ- 


Feasi- 


Situ- 


Feasi- 


Situ- 


Feasi- 


Situ- 


Feasi- 




ations 


bility 


ations 


bility 


ations 


bility 


ations 


bility 




Survey 


Sc res 


Survey 


Scores 


Survey 


Scores 


Survey 


Scores 


Statements 


.33** 


.38** 












.54** 


Survey 


• 13 


,31 


.45* 


.27 


• 39 


«>i cuaciort3 
Survey 




.72** 




,68** 




.82** 




** 


Posttest Scores: 


















Statements 
Survey 


.25* 


.12 


.07 


,09 


.15 


.08 


,61** 


* 

.51 


Situations 
Survey 




.87** 




,86** 




.91** 




,91** 


Note. Because of 


incomplete 


data, n*8 range from 69 


- 72 for all 


sites combined and from 


19 - 21 for 


the urbai 


site. For 


the suburban and rural 


sitesy n*s 


remain constant at 29 and 


22 respectively. 





*£v .05 



Table 17 



Correlations Among the Three Attltui^e Measures 
for Junior High Teacher ExperlaentaJ Groups 



All Sites Combined 



Urban Site Only 



Suburban Site Only 



Rural Site Only 



Pretest Scores: 



Situ- 
ations 
Survey 



Feasi- 
bility 
Scores 



Situ- 
ations 
'Survey 



Feasi- 
bility 
Scores 



Slti^ Feasl- 
atlons bllity 
Survey Scores 



Situ- Feasi- 
atlons bllity 
Survey Scores 



Stateaents ^ 

Survey .46 .36** .44* .37 .10 .51* .60 .20 

Situations 

Survey .71** .79** ,73** .52* 



Post test Scores : 
Statements 

Survey .02 .05 .33 .40 -.04 -.07 -.13 -.10 

Situations 

Survey .82** .86** .86** .74** 



Note. Because of incomplete data, n*s range from 54 - 58 for all sites combined, 19 - 21 for the urban site, 
17 - 21 for the suburban site, and 15 - 17 for the rural site. 



*E ,-05 
£^ .01 
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.60 at the rural site to .78 at the suburban site. These high 
correlations are not surprising in that the two scores are obtained 
from the sane instrument and. both derive from the semantic 
differential technique for assessing attitudes. Similarly high 
positive correlations between these two s/ets of scores were found 
when only the scores of comparison group teachers were considered 
(Table 16) and when only experimental group teachers' scores were 
considered (Table 17) . Asterisks are used in these tables to indicate 
where correlations are significant. Fcr example, while a correlation 
of .31 between pretest Statements Survey scores and pretest Feasibility 
scores for both treatment groups combined at the urbcn site is signx* 
ficant (£<..05), this same correlation of .31 between pretest Statements 
Survey scores and pretest Fea:,ibility scores for the urban comparison 
group only is not significant becovse of the smaller sample size on 
which the correlation is based. Table 18 presents pretest-posttest 
corrzlations for each of the three attitude measures. 

Attitude Change and Credit Status 

One additional analysis was conducted '^n the data generated by 
the three attitude measures. Because it appeared that the variable 
of credit status might account for whether or not teachers' attitudes 
changed over the experimental treatment period, a credit stains x time 
analysis of variance was conducted in wfiicli the total experimental 
sample (n « 58) was divided into two groups, those who elected to 
participate in the inservice workshop program in order to earn graduate 
credit and those who elec**-;: tc frfftit .nate for no credit. Table 19 
presents t^*> means for each of thcc** tvo grou:)s Cadi'isted ^or »jnequal 



Table 18 



Pretese-Posccesc Correlaclons for Junior High Teachers on 
Three AtclCude Measuxes 



All Sices 
Combined 



Urban Sice Only 



Suburban Sice Only 



Rural Sice 
Only 



Treacaenc Groups 
Coabined 

Scaceiiencs Survey 
SiCuaCions Survey 
Feasibilicy Scores 



.44 
.42 
.29 



** 



.32' 

.24 

.18 



,45 
.44 



** 



** 
** 



.61 
.57 
.32^ 



** 
** 



Comparison Group 



Scaceoiencs Survey .45 
SiCuaCions Survey .43 
Feasibilicy Scores .34 



** 
** 



** 



.36 
.26 
.17 



.40^ 
.45* 
.49 



** 



.72 
.65 
.57 



** 
** 



** 



Experifliencal Croup 



Scacc-*encs Surrey .46 
SiCuations Survey .44 
Feasibilicy Scores .31^ 



** 
** 



.26 
.26 

.30 



.70 
.6/ 
.45 



.45 
.49 

.07 



*£<.05 
**£< .01 
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Table 19 

Estimated Mean Scores on Ttiree Attitude Measures for 
Credit and Nor. Credit Experimental Junior High Teachers 



Statements Survey Scores 



Credit teachers 
(n - 35) 

Non credit teachers 
(n - 23) 

All teachers 

(n - 58) 

Situations Survey Scores 

Credit teachers 
(n - 35) 

Non credit teachers 
(n - 22) 

All teachers 

(n - 57) 



Pretest 

8A.26 
89.51 
86.88 



3A7.97 
333. AA 
3A0.71 



Posttest 

89.86 
92.86 
91.36 



373.69 
36A.90 
369.29 



Both tines 
Combined 



87.06 
91.19 



360.83 
349.17 



Feasibility Scores 

Credit teachers 

(n - 35) 64.11 
Non credit teachers 

(n - 22) 60.73 
All teachers 

(n - 57) 62.41 



73.37 
70.61 
71.99 



68.74 
65.66 
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n*8) on the Statements Survey, the Situations Survey, and the 
Feasibility scores. Tables 20, 21, and 22 are summary tables for 
the credit status x time analysis of variance for the Statements 
Survey, Situations Survey, and Feasibility scores respectively. No 
significant effects were found for credit status, or credit status 
X tine. Whether ^ not a teacher elected to participate in the 
inservice workshop pjogran for credit or no credit was not signi- 
ficantly related to attitude change during the experimental treatment 
period. 

Morale Aaong^ Junior High School Teachers 

The Purdue Teacher Opinionaire (PTO) was administered to all 

teachers in the investigation, both experimental and comparison, for 

the purpose of obtaining a measure of morale. It was anticipated 

t 

that teacher attitude toward the integration of reading instruction 
in content area classrooms eight be significantly affected by morale 
as measured by the PTO, If this were the case, teacher morale could 
be used as a covariate in an analysis of variance for the effects of 
the experimental treatment. 

Analysis of Morale Measure Scores 

Table 23 presents tae pre and posttest observed mean scores for 
both treatment groups at the three sites combined and for each site 
separately, for the experimental groups only (combined and by site), 
and for the comparison groups only (combined and by site). Table lU 
presents the summary data for a sites x treatment analysis of variance 
on the pretext scores. Two significant effects were found with regard 
CO these scores: a site x treatment interaction ond a site main 
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Table 20 

Credit Status x Time Analysis of Variance 
Dependent Variable: Junior High Teachers' 
Statements Survey Scores 



Source 


df 


MS 


F 


£ 


Credit status 


1 


6 


.25 


^~ 1 


^ .05 


Error (between) 


56 


98 


.30 






Time 


1 


555 


.61 


13.96 


' .001 


Credit X Time 




35 


.20 


«^ 1 


.05 


Error (within) 


56 


39 


.80 • 







Table 21 

Credit Status x Time AnaJ^sis of Variance 
Dependent Variable: Junior High Teachers' 
Situations Survey Scores 



Source df MS 



Credit status 1 4556.2 1.98 .05 

Error (between) 55 2302.2 

Time 1 22075.0 24.56 *'.001 

Credit x Time 1 222.56 < 1 , .05 

Error (within) 55 89&.64 
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Table 22 



Credit Status x Time Analysis of Variance 
Dependent Variable: Junior High Teachers* 
Feasibility Scores 



Source 


df 


MS 




F 


* 


£ 


Credit status 


1 


90. 


25 


< 1 




> .05 


Error (between) 


55 


115. 


58 






Time 


1 


2481. 


20 


39.59 




< .001 


Credit X Time 


1 


2. 


87 


< 1 




.05 


Error (within) 


55 


62. 


68 







\ 
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Table 23 

Observed Mean Scores of Junior High Teachers on Purdue Teacher Oplnlonalre 





Ai 1 Sites coisD ineu 


Urban Site 


Only 


Suburban Site Only 


Rural Sice Only 




Pre Post 


Pre 


PObt 


Pre 


Post 


Pre 


Post 


Treatment Groups 


(n - 127) 


235.08 

(n 


231.95 
- 40^ 


323.57 

(n 


324.06 
- 49) 


300.84 

(n 


300.86 
- 38) 


Experlnental Groups 
Only 


284.38 284.33 
(n-55) 


245.21 239.68 
(n - 19) 


315.00 

(n 


317.70 
- 20) 


292.63 

(n 


295.63 
- 16) 


Comparison Groups 
Only 


293.50 292.93 
(n - 70) 


223.15 225.11 
(n - 19) 


329.48 

(n 


328.45 
- 29) 


306.82 

(n 


304.68 
- 22) 



9: 
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Table 24 

Sites X Treatment Analysis of Variance of 
Junior High Teachers' Purdue Teacher Opinlonalre Pretest Scores 



Source 


df 


MS 


F 


£ 




Sites 


2 


111,961.00 


108.14 


< .001 


9 


Treatment 


1 


66.90 


< 1 


> .05 




Site X Treatment 


2 


5,248.40 


5.07 


< .01 




Error 


145 


1.035.40 
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effect. The pretest site main effect was that morale, as measured 
by the PTO, was significantly lower for all subjects at the urban 
Junior high school. Follow-up tests showed that a*, the urban site 
the scores of the treatment groups were significantly different, the 
•cores of the comparison group being higher than the scores of thp 
experimental group. However, at the other two sites, pretest scores 
of the two treatment groups did not differ significantly. The 
nonsignificant treatiMnt effect indicates that with all sites com- 
bined, the treatment groups were not significantly different when 
the treatment began. 

Table 25 presents the sumury date for a site x treatment x 
time analysis of variance on PTO scores- The only significant effect 
found was that at the urban site morale scores for both treatment 
groups were significantly lower than morale scores for teachers at the 
other two sites. Table 26 presents the estimated means for this 
significaat site main effect. Of primary interest, however, is the 
fact that no significant time effect (pre to posttest difference) was 
found for PTO scores overall (time main effect) or within sites (site 
X time interaction) or within treatment groups (treatment x time 
interaction). Morale, as measured by the PTO, then, held constant 
across time for all teachers and all sites, being significantly lower 
for all teachers at the urban site just as establisheJ on the pretest. 

Correlations Between Morale Scores and Attitude Scores 

Tables 27, 28, and 29 present the correlations between scores on 
the PTO and Che three attitude measures. Asterisks denote correlations 
that are signi. .cant. A close examination of these cables suggests 
that teacher responses on the attitude measures were not significantly 
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Table 25 



Site X TreataenC x Tine Analysis of Variance 
on Junior High Teachers' Purdue Teacher Oplnlpnaire Scores 



Source 


df 


MS 


F 


£ 


Sice 


2 


14,802.00 


7.00 


< .01 


TreataenC 


1 


44.08 


. 1 


.05 


Sice X Treatvent 


2 


220.08 


: 1 


> .05 


Error (between Ss) 


li9 


: 114.80 






TlM 


1 


1.85 


1 


^ .05 


Site X Tloe 


2 


40.03 


^ 1 


^ .05 


Trcataent x Tlae 


1 


3.28 


1 


> .05 


Site X Tre«t»ent x Tlae 


2 


231.49 


• 1 




Error (within Ss) 


119 


233.78 







Table 26 

Estimated Junior High Teachers' Purdue Teacher Oplnlonalre 
Means for Only Significant Effect 



Site Urban Rural Suburban 

225.17 308.15 320.90 
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Table 27 

Correlations Between Purdue Teacher Opinionaire Scores and Three Attitude 
Hea&ures for Junior High Teacher Treataent Groups Combined 



ERIC 



All Sites Combined 

FTO pretest scores 
PTO posttest scores 



Urban Site Only 

PTO pretest scores 
PTO posttest scores 



Suburban Site Only 

PTO pretest scores 
PTO posttest scores 



Rural Site Only 

PTO pretest scores 
PTO posttest scores 



Stateaents 

Survey 
Pretesc 


ScaceaenCs 
Survey 
Posccesc 


Sicuadons 
Survey 
Precest 


Sicuadons 
Survey 
Posccesc 


Feasibilicy 
Scores 
PreCesC 


Feasibilicy 
Scores 
Postcesc 


.16 


.20 


.00 


.17 


.17 


.18 


.16 


.21 


-.02 


.16 


.14 


.18 


-.05 


.04* 


-.09 


.23 


-.04 


.28 


-.06 


.38 


-.04 


.13 


-.03 


.19 


.14 


-.02 


.08 


.09 


* 

.31 


.09 


.20 


.01 


.04 


.08 


.25 


.07 


.16 


.18 


.06 


-.03 


.13 


-.08 


.09 


.29 


-.09 


.09 


-.05 


.09 



Note , uecause of incomplete data, n*s range froa 126 - 130 for all sites conbined, 
site, 48 • 49 for the suburban site, and 38 - 39 for the rural site. 



38 * 42 for the urban 
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Table 28 



Correlations Between Purdue Teacher Oplnlonalre Scores and Three Attitude Measures 
for Junior High Teacher Comparison Groups Only 





Statements 


Scateaencs 


Situations 


Situations 


Feasibility 


Feasibility 




Survey 


Survey 


Survey 


Survey 


Scores 


Stores 




Pretest 


Posctest 


Pretest 


Posttest 


Pretest 


Posttest 


All Sites Coiia>lned 




f- 










pro pretest scores 


.15 


.26* 


-.04 ' 


.21 


.10 


.24* 






28* 

• xo 






HQ 


21 
• A, J 


Urban Site Only 














pro pretest scores 
pro post test scores 


-.18 
-.20 


.43 
.44 


-.20 
-.06 


.01 
.03 


-.32 
-.27 


.10 
.05 


Suburban Site Only . 














pro pretest scores 


.01 


-.08 


-.03 


.09 


.21 


.13 


pro posttest scores 


.02 


-.09 


-.05 


.15 


.17 


.15 


Rural Site Only 














pro pretest scores 


.22 . 


.27 


.01 


.14 


.16 


.07 


PTO posctest scores 


.23 


.34 


-.11 


.26 


.15 


.19 



Note. Because of incoaplete data, n's range fro* 69 - 72 for all sites conbined, and 19 - 21 for the urban 
site. For the suburban and rural sites, n's remain constant at 29 and 22 respectively. 

*£< .05 
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Table 29 



Correlations Between Purdue Teacher Opinlonalre Scores and Three Attitude Measures 
fcr Junior High Teacher Experimental Groups Only 



X 



All Sites Coabined 

PTO pretest scores 
pro post test scores 



Urban Site Only 

PTO pretest scores 
PTO post test scores 



Suburban Site Only 

PTO pretest scores 
PTO P9stcest scores 



Rural Site Only 

PTO pretest scores 
PTO posttest scores 



Stateaents 
Survey 
Pretest 


Stateaents 

Survey 
Posttest 


Situations 
Survey 
Pretest 


Situations 
Survey 
Posttest 


feasibility 
Scores 

Pre test 


Feasibility 
Scores 

Posttest 


- 

.18 


.17 


.05 


.14 


.26 


.14 


.20 


.19 


.04 


.10 


.18 


.17 


-.01 


.30 


• 

-.01 


.34 


•- 

.22 


.43 


.06 


.25 


.02 


.19 


.22 


.35 




.35 


.19 


.13 


.38 


.14 


.50 


.49* 


.13 


.02 


.31 


.05 


.12 


.12 


.16 


-.15 


-.05 


-.22 


-.10 


.27 


-.04 


-,13 


/ -.42 


-.02 
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Note. Because of Incomplete data, n's range from 54 - 58 for all sites combined. 19 - 21 for the urban site. 
17-20 for the suburban site, and 15 - 17 for the rural site. 
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affected by their responses on the PTO. Morale, as measured by the 
PTO, appears not to have been a significant factor in determining 
teachers' attitudes toward the integration of reading instruction 
In thr content areas as measured by the three attitude instruments 
used in this investigation. It therefore seemed unnecessary to 
analyze the data using PTO morale scores as a covariate to minimize 
the effect of morale on attitude. 

A close examination of the figures in Tables 27, 28 and 29 
confirms the minimal relationship found between teacher responses 
on the PTO and subject responses on the three attitudinal measures. 
Table 27, for example, indicates that for both treatment groups 
combined at all sites, correlations between PTO pretest scores and 
pretest scores on the three attitude measures are .16 for the 
Statements Survey scores, .00 tor the Situations Survey scores, and 
.17 for the Feasibility scores. Since none of the three correlations 
are statistically significant. It can be concluded that there is no 
reliable relationship between responses on the PTO and responses on 
the three attitude instruments. The generally low relationships 
become clearer when is considered, the variance in one variable 
accounted for by the other. For example, the correlation between 
PTO pretest scores and posttest scores on the Statements Survey 
among both treatment groups combined at the urban site is .40. This 
is the highest correlation found in Table 26, yet 4^ equals .16, 
which means that only 16Z of the variance in Statements Survey post* 
test scores among all urban teachers in the investigation can be 
attributed to these teachers' responses to the morale measure. 
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Tables 28 and 29 present the correl .ween the PTO scores 

and the three attitude measures for the ixperlmental and comparison 
groups respecclvely, each of these also b^en down by site. These 
correlations range from -.42 for th^^ PTO poatteat ^corea and pretesw 
Feasibility scores among the experimental teachers at the rural site 
to .50 for PTO posttest scores and Statements Survey pretest scores 
«among these same teachers. The magnitude of the relationship between 
measures when considered in terms of variance accounted for (xh 
reaches a maximum of 125 among, the experimental teachers at the rural 
site. Amorig the comparison teachers, the highest correlation on 
Table 27 is .43 between PTO pretest scores and Statements Survey 
posttest scores for urban subjects. The highest percentage of 
variance in PTO scores ainong these subjects that can be attributed to 
morale measure responses is thus 18Z. 

Skill Levels Among Junior High School Teachers 
Hypothesis number two in Chapter One states that a significantly 
greater number of experimental teachers will attain mastery level of ^ 
80Z on the posttest administration of a skills test than attair this 
mastery level on a pretest administration of this test. 

Analysis of Skills Test Scores 

Hypothesis number two was accepted. Using th*^ McNemar Test for 
the significance of changes, significantly more leathers changed from 
nonmastery at pretest to mastery at posttest than from mastery to 
nonmastery, x^ (l) « 15.43, £<.001 on the Skills Test. Table 30 
presents the numbers of teachers reaching mastery on pre and posttest 
at all sites combined and for each site separately. Of the 56 



107 
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Table 30 

Frequency of Junior High Experimental Teachers In each Combination 
of Pre and Posttest Mastery Status on Skills Test 



All Sites Coablned 

Pretest: Mastery 

Nonmastery 
Total 

Urban Site 



Pretest: Mastery 

Nonmastery 
Total 

Suburban Site 



Nonmastery 



1 

33 
34 



1 

18 
19 



Posttest 
Mastery 



2 

2C 
22 



0 
2 
2 



Total 



3 

53 
56 



1 

20 
21 



Pretesn: Mastery 

Nonmastery 
Total 

Rural Site 
./ ~ 

Pretest: Mastery 

Nonmastery 
^ Total 



0 
8 
8 



0 
7 
7 



0 

12 

12 



2 
6 
8 



0 

20 

20 



2 

13 
IS 
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experimental group teachers who took the test at the first workshop 
session, only three scored 80Z or better. Of these same 56 teachers* 
22 reached mastery level of 80Z on the posttest given at the final 
workshop session. 

While MStery level Is the primary concern when using a criterion- 
referenced test, it is also of some Interest to consider whether or 
not teachers improved their performance on the Skills Test and to what 
extent. Table 31 Includes the observed or actual mean scores for all 
sites combined and for each site considered separately. Table 32 pre- 
sents the estimated mean scores for the data adjusted for unequal n's. 
These means represent the scores used for a site x time analysis of 
variance on the Skills Test. Table 33 summarizes this analysis of 
variance. Significant gains wer3 found between pre and posttest 
(£<.001). Gain was not related significantly to site. 

One further analysis of variance was conducted on the Skills Test 
data to determine whether or not a teacher's decision to participate 
in the inservice workshop program for graduate credit or non credit was 
significantly related to changes in Skills Test score. Table 34 pre- 
sents estimated cell means, for Skills Test scores adjusted for 
unequal n's, for experimental teachers electing to participate in t!ie 
treatment for graduate credit and for teachers electing the non credit 
option. Table 35 summarizes the credit status x time analysis of 
variance. No significant effects were found for credit status or 
credit x time. In other words, change in Skills Test scores was not 
significantly related to whether or not a teacher elected the graduate 
credit option offered as part of the experimental treatment. 

1 0^^ 



Table 31 

Junior High Experiaental Teachers* Observed Hean Scores on Skills Test 





All Sites Coabined 


Urban Site Only 


Suburban Site Only 


Rural Site Only 


Pretest 


9.96 
(n - 56) 


9.33 
(n - 21) 


10.90 
(n - 20) 


9.60 
(n - 15) 


Posttest 


16.89 
(n - 56) 


15.76 
(n - 21) 


17.90 
(n - 20) 


17.13 
(n - 15) 






Table 32 








Junior High Experinental Teachers' Estimated Mean 

Test Adjusted for Unequal n's 


Scores on Skills 




Site; 


Urban (n " 21) 
Suburban (n « 20) 
Rural (n - 15) 


12.55 
1A.A3 
12.55 






Tine: 


Pretest 
Posttest 


9.68 
16.67 






Site X Tine: 


Pretest 


Urban: 9.33 


Suburban: 10.93 


Rural: 8.78 



Posttest 



Urban: 15.76 



Suburban: 17.93 



Rurol: 16.31 
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Table 35 

Credit Statu* x Time Analysis of Variance for 
Junior High Experimental Teachers' Skills Test Scores 



d£ MS 



Source 



Credit Status 1 4.00 .. 1 .Oi 

Error (between) 54 15.12 

Tl^ 1 1317.80 193.77 < .001 

Credit X Time l 1.53 v. 1 .05 

Error (within) 54 6.80 
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Analysis of Perceived Skill Scores 

Another dimension of skill is reflected in teachers* responses to 
the final question included as part of the Situations Survey. 7or each 
plan described on this instrument, the teacher is asked to rate his 
perceived degree of skill at executing the plan presented. It should 
be noted that only on this skill measure were data collected from both 
experimental and comparison teachers; on the other two skill measures 
(the Skills Test and the consultant ratings) data were collected from 
experimental teachers only. Table 36 presents the observed mean 
Perceived Skill scores of subjects across sites and for each site 
considered separately. Table 37 sum:arizes a site x treatment x time 
analysis of variance. The increase in Perceived Skill scores from 
pretest to posttest was greater for experimental teachers (£<..001). 
This differential increase was not found to be related to site. 
Table 38 presents the estimated Perceived Skill sccres, adjusted for 
unequal n's for the significant effects from this analysis. 

Analysis of Consultant Ratings 

A final way to look ac changes in skill level among teachers 
participating in the experimental treatment is to consider evaluations 
made by the on site consultants who observed the teachers at work in 
their classrooms between workshop sessions. At the end of the 
treatment period, each consultant was asked to assign an entry rating 
to each^ teacher with whom he or she had worked during the year. This - ^ 
rating was based on what the consultant believed to be that teacher's 
level of skill in relation to the objectives of the workshop program. 
In othei words, teachers* entry ratings reflected the extent to which 
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Table 36 

Observed Mean Perceived Skill Scores of 
Junior High Experiaental Teachers 





All <:irM 
Pre 


PnaM nril 

\^\MWMV All W 

Post 


UrKan Site Onlv 

Pre Post 


Stiliu rhan Site 

Only 
Pre Post 


Rural Site Only 
Pre Post 


Treatment Croups Coabined 


61.60 

(n - 


69.96 
129) 


61.76 71.55 
(n - 42) 


62.79 68.71 
(n - 48) 


59.95 

(n - 


69.82 
39) 


Ejcperiaental Groups Only 


59.46 

(n - 


74.91 
57) 


60.52 75.48 
(n - 21) 


58.11 73.21 
(n - 19) 


59.65 
(n - 


76.12 
17) 


Coaparlson Croups Only 


63.29 

(n - 


66.06 

72) 


63.00 67. C2 
(n - 21) 


65.86 65.76 
(n - 29) 


60.18 

(n - 


64.95 
22) 



A. 5-79 



Table 37 

Sice X TreacaenC z Tlaie Analysis of Variance on 
Junior High Expcrlaencal Teachers' Perceived Skill Scores 



df MS F £ 

Source 



Sice 


2 


68.08 


^ 1 


.05 


TreacaenC 


1 


70.08 


1 


' .05 


Sice X TreacaenC 


2 


66.08 


< 1 


> .05 


Error (becveen Ss) 


123 


229.82 


V 1 


-. .05 


Tlac 


1 


5434.70 


74.78 


.001 


Sice X TlM 


2 


56.12 


1 


' .05 


TreacaenC x Tlae 


1 


2419.20 


33.29 


.001 


Sice X TreacaenC x Tlae 


2 


34.92 


< 1 


. .05 


Error (wlchln Ss) 


123 


72.68 







Table 38 

EsclaaCed Cell Means for SlgnlflcanC Effeccs Froa Analysis 
of Variance on Junior High Expcrlaencal Teachers' Perceived 

Skill Scores 



Pre Post 

Tlac 61.70 71.00 

TreacaenC x Tlae 

Expcrlaencal 60.70 76.21 

Coaparlson 62.69 65.79 
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Table 39 

Mean Consultant Ratings of Skill Levels for Experiaental Junior High Teachers 



All Sites Coabined Urban Site Only Suburban Site Only Rural Site Only 

bcry Rating 2.20 1.48 2.80 2.41 

(n - 58) (n - 21) (n - 20) (n - 17) 

fKlC Rating 3.54 2.11 3.85 4.06 

(n - 58) (n - 21) (n - 20) (n - 17) 



■oi:c. Racings ranged from 1 to 5 1th 5 being the highest positive rating. 
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th€ consultants believed that the teachers had incorporated reading 
Instruction in their content area classrooas at the beginning of the 
experimental treatnent. An exit rating was also recorded lor each 
teacher which reflected the extent to which the consultants believed 
that teachers incorporated reading instruction in their classrooms 
by the end of the experimental treatnent. It should be noted that 
SOM caution should be exercised in .aterpreting the analysis of 
these ratings as they were collected at the end of the treatment 
period rather than before and after which would have minimized rater 
bias. 

Table 39 includes the mean entry and exit rat4|ngs on which a 
matched pairs t^ test Was used for comparing ratings for all sites 
combined and for each site separately. Mean exit ratings were' 
sigTiificantly higher than mean ratings across all sitcst 
t^ (57) • -9.851, £ C.OOl, and for each «icc, £ (20^ « -A. 939, ^ 
£<.001 (urban), t^ (19) • -5.694, £<.00i (suburban), and 
(16) - 7.99, £ C.OOl (rural). 

Thus on three dimensions of skill measured, the dntn indlcnto 
significant changes in skill levels among participants In the 
experii^ental treatment group across time. 

Correlations Among Skill Measures 

Table AO presents the correlations among these three dimensions 
of skill neasurement. Where correlations are statistically signi- 
ficant, asterisks are used. This table indicates that one of the 
highest correlations among the skill measures used in this investi- 
gation is that between the Skills Test pretest scores and the 
consultants* Entry Ratings. For all sites coi^bine<l, for cxnmplc, 
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Table 40 



Correlations Among Three Skill Meaaures For Junior High Sxperiaental Teachers 

























All. Sites 


Combined 


Urban Site Only 


Suburban 


Site 


Rural Site Only 








• 




• 


Only 












Perceived - 


Entry 


Per- 


Entry 


Per- 


Entry 


Per- 


Entry 






Skill 


Rating 


ceived 


Rating 


ceived 


Rating 


ceived 


Ratine 




• 


Scores 




Skill 




Skill 




Skill 








• 




Scores 




Scores 




Scores 






Pretest Correlatioas 




















Skills Test Scores 


.17 


.34* 


.17 


.65** 


.00 


.37 


.46 


.08 




Perceived Skill Scores 




-.01 




.17 




.14 




-.23 




Post test Correlations 




















Skills Xest Scores 


.14 


.26* 


.26 


.23 


.14 


.21 


.28 


-.08 




Perceived Skill Scores 

i 




.26 




.29 




.32 




.47 





Note. Because of incoaplet< data the following ranges of sanple size apply to this table: n-S5-S8 for all 
sites conbined; n-21 for the urban site; n-19-20 for the suburban site; n-15-l7 for the rural site. 

*£<.05 
**p<.01 
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this correl;ition is .3^. However, looking at this correlation for 
Mch sits separately, the table indicates that only at the urban 
and suburban sites is this high correlation evident (.65 and .37 
respectively) while at the rural site the correlation drops to .08. 
The wide range in these correlations may reflect the lack of 
establishing inter-rater reliability with regard to the assigning 
of ratings by consultants. Table 41 presents the pretest-posttest 
correlations for each of the three skill measures. 

Characteristics, Attitudes, Morale , and Skill Levels 
of Teachers of Adults 

ft 

For a variety of reasons, to be discussed in Chapter Five, the 
Adult Basic Education (ABE) part of the total sample used in this 
iavestigation was considerably smaller than anticipated. Attrition 
among those teachers of adults who began as part of the experimental 
group was a serious problem as was maintaining a comparison group for 
pre and posttesting. Because the Adult Basic Education treatment 
groups eventually maintained were so small, data collected on these 
groups is reported separately from that of the secondary teacher 
sample. Meaningful comparisons between groups of such differing 
size are not suggested. In addition to noting the very small sample 
numbers for this part of the investigc^tion, one additional caution 
needs to be made. For the secondary teacher population, only 
teachers who attended at least ten of the fifteen workshops were 
considered experimental teachers. Because one of the major reasons 
for the high attrition race among the teachers of adults in the 
experimental group was the problem of attending workshop sessions 
that frequently conflicted with teaching commitments, it was decided 
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Table 41 

Pretest-Post test Correlations for Junior High Teachers' Scores on 
Three Skill Level Measures 



All Sites Combined Urban Site Only Suburban Site Only Rural Site Only 



Skills Test Scores 
Perceived Skill Scores 
Entry-Exit Ratings 



.44 
.23 

.56 



** 



.23 
.18 
.38 



.63 
.16 
.52 



** 



.47 
.42 
.45 



*£ < .05 
**£^ .01 
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to consider as an experimencal teacher any Adult Basic Education 
teacher who attended at least six of the workshop sessions. 

For the tables presenting data on the experimental group of 
Adult Basic Educatioif teachers » only one breakdo%m is considered 
anong the small total population of eight, that of credit versus 
non credit. Because this category distinction has been made for 
the secondary teacher sample and was n source of some difference 
in terms of completion of workshop objectives and attendance, the 
group of teachers of adults was divided in the same way. Again, 
however, considerable caution needs to be exercised in interpreting 
the tables which include this breakdown because of the very small 
total sample. No attempt was made to determine statistical 
differences for this breakdown of credit versus non credit. The 
information is provided for descriptive purposes only as is much 
of the data for thi? part of the investigation. 

Characteristics of Teachers of Adults 

Table 42 presents summary descriptive demographic information 
gathered on Adulc Basic Education subjects for whom both pre and 
posttest data were available. The Fisher exact probability test 
was used to determine whether differences in the two groups were 
statistically significant. No significant differenccfl were fotind 
between the treatment groups on the variables included in this 
table. Information on content areas represented by the Adult Basic 
Education subjects in both treatment groups was collected and 
analyzed and two significant differences were found between the 
experimental and comparison groups. A significantly higher number 
of comparison Adtilt Basic Education teachers reported that thoy 




The term Adult Basic Education was defined in Chapter 1 of this 
project to include teachers of Adult Basic Education, General Educa- 
cimal Department and English as a Second Language* 
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Table 42 

Suanary Deaographic Inforaatlon on Experimental 
and Comparison Adult Basic Education Groups 





Experimental 


• 

(n-8) 


Comparison 


(n-9) 


• 


I 


1 




X 


Nuaber of years teaching experience: 










0-3 years 


2 


25.0 


1 


11.1 


4-7 years 


2 


25.0 


3 


33.3 


8-11 years 


1 


12.5 


2 


22.2 


12-15 years 


2 


25.0 


3 


33.3 


more than IS 


1 


12.1 


0 


0 

' 


Level of education: 










high school graduate 


0 


0 


0 


0 


some college work 


0 


0 


0 


0 


undergradtiate degree 


4 


50.0 


4 


44.4 


waster's degree 


4 


50.0 


5 


55.6 


doctorate 


0 

• 


0 


_Q 


0 


College credits beyond undergraduate 










0-10 


1 


12.5 


1 


11.1 


11 - 20 


1 


12.5 


1 


11.1 


21 - 20 


1 


12.5 


3 


33.3 


31 - 50 


2 


25.0 


2 


22.2 


more than SO 


3 


37.5 


2 


22.2 


Credits earned In reading Instruction 










0-6 


5 


62.5 


6 


66.7 


7 - 12 


2 


25.0 


2 


22.2 


13 - 18 


1 


12.5 


1 


11.1 


19 - 24 


0 


0 


0 


0 


more than 24 


0 


0 


0 


0 
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taught math and special education than experimental teachers 
(£<.05}. Some caution should be exercised In considering this 
significant difference In that there was some confusion on the 
part of the teachers of adults who completed the questionnaire 
as to how to respond to the questions dealing with content areas 
taught. Many of these teachers reported that they taught In a 
substantial number of the categories or were unsure exactly how to 
respond to the questions. They apparently confused the content 
ai.eas they taught as full time Junior high school teachers with 
what they taught a» part time teachers of adalts. 

Table 43 presents comparison data between those experimental 
Adult Basic Education subjects who elected one of the credit options 
and those who elected to attend the workshop for no credit. These 
subjects are compared on various aspects of the experimental 
treatment. For example, of the eight experimental subiects, only 
two elected to complete the workshop program for graduate credit, 
and one of these two teachers was the only Adulr Basic Education 
teacher who completed enough of the required objectives to cam a 
certificate of completion. In other words none of the teachers 
of adults attending the workshops as non credit subjects completed 
enough work to earn a certificate. In fact» of the, six non credit 
Adult Ba^lc Education teachers, the mean number of skill level 
objectives completed was 2.33 out of a possible total of 9 objectives. 

Attitudes and Morale of Teachers of Adults 

Table 44 presents pre and posttest observed mean scores on the 
three attitude measures and the Perceived Skill scores for the total 
Adult Basic Education sample. Tables 45 nnd 46 present the pre and 
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Table 43 



Credit Versus Non Credit Adult Basic Education Teachers Compared on Variables of 
Completion of Objectives and Workshop Attendance 





Total Complet- 
ing Skill Level 
Ob J ectives 


Mean Number 

^of Skill 

"'Level Objec- 
tives Comp- 
leted 


Total com- 
pleting 
Classroom 
Application 
Objectives 


Total 
Eligible 
for Certi- 
ficate of 
Completion 


Mean Number 
of Objective 
Completed of 
Possible 13 


Mean Number 
of Workshop 
Attended of 
possible 15 


ABE Teachers 
electing 3. or 
6 credit option 
(n - 2) 


1 


8 


2 


1 


12 


12.5 


ABE Teachers 
electing non 
credit option 
(n - 6) 


0 


2.33 


0 


0 


2.5 


9.67 


Total ABE Teachers 
(n - 8) 


1 


J. 75 


2 

1 

1 


1 

1 


A. 88 
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Table 44 

Observed Mean Scores on Four Measures for ToCal 
'^•jIC Basic^ Education Saaples (n - 17) 





Pre 


Post 


Scateaents Survey 


88.882 


89.059 


Situations Survey 


341.647 


334.529 


Feasibility Score 


63.824 


63.294 


Perceived Skill Score 


58.647 


65.118 



Table 45 

Observed Mean Scores on Four Measures for 
Coflq>arison Adult Basic Education Group Only (n « 9) 





Pre 


Post 


Statenents Survey 


91.333 


90.556 


Situations Survey 


344.667 


319.333 


Feasibility Score 


63.889 


57.778 


Perceived Skill Score 


63.556 


65.778 
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Table 46 



Observed Mean Scores on Four Measures for ExperiaenCal 
Adulc Basic Education Croup Only (n » 8) 



Pre Post 

Stateaents Survey 8|.125 87.375 

Situations Survey 333.250 351.625 

Feasibility Score 63.750 69.500 

Peiceived Skill Score 53.125 64.375 



A.5- 

posccesc observed aean scores on chese aeasures for che co«pa,rlson 
and experiaental groups sepnately. Mean scores on the Purdue 
Teacher Opinionsire are not included becawie pre and posttest 
data vere available for only four subjects. Also, as discussed 
in Chapter Five, this aeasure proved to be inappropriate for 
teachers of adults and was therefore not included in the analyses 
of data for this part. 

Tables 47, 48, and 49 are suMsry tat»les for a tise x 
treatment sihslysis of variance of the three attitude measure scores 
of Adult Basic Education teachers. No significant effects were 
found. 

. 

Skill Levels of Teachers of Adults 

Table SO presents the pre and postr<»st wan Skills Test score 
coaparisons for Che Adult Basic Educatioi experinental group* No 
experiaent"! teacher reached ustery level of 80Z on the pretest. 
Two of the six teachers with complete pre and posttest data reached 
■astery oo the posttest. Looking at mean scores indicates the 
extent of actual ii^iroveaent aaong theie teachers on the Skills Test. 
Table 50 indicates that for the total ^xperiaental Adult Basic 
Education group, the pretest aean score of 7, out of a possible 23, 
increased to a posttest «eon of 14.50. This difference was fiigni- 
ficant, t^(5) • 5.07, £<.01. Again, however, caution is advised in 
interpreting these findings because of the small sample on which 
they are based. 

Table 31 presents data on the two other dimensions of skill 
analyzed in the investigation. He&n pre and posttest Perceived Skill 
scores are presented with oiean consultant entry and exit rntinKS. 
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Table 47 

Treataent x TIm Analyals of Variance of 



Adult Basic Education Teachers' 


Stateaents 


Survey Scores 








df 


MS 


F 


£ 




Source: 












Treataent 


1 


30.25 


^1 


>.05 




Error (between) 


15 


55.36 










1 


.47 


< 1 


> .05 




TIbc X Treataent 


1 


8.71 


^1 


7 .05 




Error (vlthin) 


15 












Table 48 








Treataent x 


Tiae Tiae Analysis of Variance of 






Adult Baalc Education Teachers' 


Situations 


Survey Scores 








iL 


MS 


F 






Source: 












Treataent 


1 


441.00 


< 1 


>.05 




Error (between) 


15 


3270.80 








Tlac 


1 


302.83 


< 1 


? .05 




Tiae X Treataent 


1 


3172.90 


1.49 


> .05 




Error (within} 


15 


2126.80 
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f Table 49 

Treataent x Tlae Analysis of Variance of 
Adult Baiiic Education Teachers' Feasibility Scores 



Source: . 

Treatment 

Error (between) 

Tiae 

Tiae X Treatnent 

Error (within) 



df MS 



1 20.25 

15 173.58 

1 .28 

1 297.92 

15 81-61 



I £ 

1 .05 

' 1 .05 

3.65 .05 



Table 50 

Adult Basic Education Experinental Teachers' Skills 
Test Results (n - 7) 



Teachers electing credit option 

(n - 2) 

Teachers electing non credit 
option (n ■ 



Total ABE teachers 



(n - 6) 



Total Reaching 80Z 
Mastery Level 



Pre 



0 
0 



Post 



Mean Score of Pos- 
sible 23 points 

Pre Post 



11.5 



9 16.0 

7 14.50 
(SD-4.09) (Sn-3.94) 



I 
I 



A. 5-94 



Table 51 



Adult Basic Education Experiiieiital Teachers' Mean 
Perceived Skill ^ores and Hean 
Consultant Ratings 





Mean' Perceived Skills 
Scores 


Mean Consultant 
Ratings 




Pre Post 


Entry Exit 


Teachers electing credit 
option (n - 2) 


53.5 - 62.5 


1 1.5 


Teachers electing non 
credit option (n • 6) 


53 65 


1.83 ^2.33 


Total ABE Teachers 

(n - 8) 


53.12 64.38 
(SD7II.37) (SD-10.76) 


1.625 2.125 
(SD-.7*) (S2-.83) 
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Differences between pre and posttest Perceived Skill scores were 
not statistically significant, t^(7) • 2.275, £> -05. Differences 
between entry and exit consultant ratings were also not stati- 
stically significant, (7) • -1.87, £> .05. 
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Table 33 

Site X Time Analysis of Variance 
of Junior High Experimental Teachers' Skill* Test Scores 



Source 
Site 

Teachers /Site 



2 

53 



MS 

35.23 
14.49 



2.43 



£ 

>.05 



TlM 

Site X Til 
Error 



1 

2 

53 



1344.10 
2.71 
6.86 



196.02 
< 1 



<.001 
> .05 



Table 34 

Estimated Cell Means for Skills Test Scores 
For Credit and Non Credit Experimental Teachers 



Credit Teachers 
(n - 33) 

Non Credit Teachers 
(n - 23) 

All Experimental Teachers 
(n - 56) 



Pretest 



9.70 



9.91 
9.80 



Posttest 



16.42 



17.12 



16.77 



Both Times Combined 



13.06 



13.52 



13.52 
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